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WALTER V. BINGHAM 
1880-1952 


In the death of Walter Bingham ap- 
plied psychology has lost one of its lead- 
ing figures. Dr. Bingham began his 
career in the era when psychology was 
mostly concerned with fundamentals, 
but he was among the earliest to see the 
practical possibilities of the subject. 
This insight, coupled with his skill in 
administrative and promotional work 
and in getting groups to work together, 
enabled him to launch a number of ven- 
tures with far-reaching consequences for 
the whole of psychology. While I was 
a student at Dartmouth I first knew him 
when he came there as Assistant Pro- 
fessor in 1910. He had secured his 
Ph.D. at Chicago two years earlier with 
prior study at Beloit, Berlin and Har- 
vard. He established a small laboratory 
along Titchenerian lines, but within a 
few years he was at the Carnegie In- 
stitute of Technology organizing the Bu- 
reau of Salesmanship Research. He as- 
sembled a notable group for that pioneer 
effort in cooperative research. The im- 
pact of such an experience on the subse- 
quent careers of the young psychologists 
working with him is hard to estimate. 
At the American Psychological Associa- 
tion meeting at Pennsylvania State Col- 
lege two years ago when some of his stu- 
dents came together with later associates 
to do him honor, it was certainly impres- 
sive just to look around the group. 

Dr. Bingham left Carnegie Institute 
in 1924 and for ten years put a major 
portion of his effort into the Personnel 
Research Federation, of which he was 
Director. Toward the end of this period 


he took up a part-time connection with 
Stevens Institute of Technology where 
he was concerned with vocational guid- 
ance and personnel psychology. He con- 
tinued there till the clouds began to 
gather for World War II, when he went 
to Washington for the rest of his career. 

Some of his most notable contribu- 
tions were in the field of military psy- 
chology. In 1917 there was not much 
applied psychology and no military psy- 
chology at all. One of the first steps was 
to set up the Committee on Classifica- 
tion of Personnel in the Army of which 
Bingham was made executive secretary. 
Presently he was commissioned Lieuten- 
ant Colonel in the Personnel Board of 
the General Staff. That was a high rank 
for those days. Only one psychologist 
ranked as a full Colonel in the first war. 
When World War II broke out Bingham 
decided to remain in a civilian capacity, 
thinking that he could thus do a better 
job. He was chairman of another com- 
mittee on Classification of Military Per- 
sonnel throughout the war period. At 
the same time he was chief psychologist 
in the Adjutant General’s office. To 
those of us who had occasion to visit him 
there during the war it was obvious that 
he was in a key position and that he had 
far-reaching influence in the program. 
He was awarded the Secretary of War’s 
Emblem for Exceptional Civilian Serv- 
ice. After the war he continued in a 
consulting capacity to the Army General 
Staff and to the Secretary of Defense. 

In connection with professional organ- 
izations he carried his share of the load: 
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secretary of the American Psychological 
Association, 1911-1914; president of the 
American Association of Applied Psy- 
chologists, 1941; president of the New 
York State Association for Applied Psy- 
chology, 1938; first chairman of the Di- 
vision of Anthropology and Psychology 
of the National Research Council, 1919; 
and on the Board of the Psychological 
Corporation for many years. 

For some years he edited the Journal 
of Personnel Research, was consulting 
editor to several other journals, and con- 
tributed various journal articles. His 
A ptitudes and Aptitude Testing, perhaps 
his major work, was being revised at the 
time of his death. In collaboration he 
wrote Procedures in Employment Psy- 
chology and How to Interview. The last 
thing he published, his “colyum” in Per- 
sonnel Psychology, described his experi- 
ences last summer at the two Interna- 
tional Conferences in Sweden. Appro- 


priately enough the article ends on a 


Harotp E. Burtt 


note of minimizing the difference be- 
tween applied and general psychology. 

It is always difficult at a time like this 
to find just the right word for the more 
personal aspects of a man’s life. He was 
friendly and pleasant in social contacts. 
He had a contagious enthusiasm. It was 
hard to keep him down. He was active 
in professional meetings in recent years 
in spite of considerable physical discom- 
fort. In the postscript to his last article 
mentioned above he was cheerfully rec- 
ommending an oxygen tent to his 
friends. 

It may well be that even more im- 
portant than his notable publications 
are the intangible contributions which 
he has made in giving counsel, encour- 
agement and stimulation to younger men 
working in his field of interest. It is 
in this capacity that many of us will 
remember him most vividly. 

Haroip E. Burtt 

The Ohio State University 





INTRODUCTION TO A THEORY OF MOTIVATION 
IN LEARNING 


BY JOHN P. SEWARD 


University of California, Los Angeles 


I. PROBLEM 


In 1942 (21) I reported an attempt 
to test Guthrie’s finality theory of rein- 
forcement. In that experiment rats that 
were removed from the apparatus as 
soon as they pressed a bar made the re- 
sponse more frequently than controls. 
But rats that were first given a food 
pellet on pressing the bar responded at 
a higher level than those that were sim- 
ply removed. This result did not fit 
easily into Guthrie’s theory, especially 
since bar pressing was more nearly the 
final response in the box for the removed 
group than for the fed-and-removed 
group. Thorndike’s or Hull’s version of 
reinforcement seemed adequate to the 
numerical data but somehow failed to do 


justice to the observed behavior of the 


animals. A naive observer would have 
said that the fed rats wanted to eat more 
than the removed rats wanted to get out 
of the box. The problem remained: how 
did the animals’ wants determine their 
behavior? 

The following year (22) I tried to 
answer the question by means of a choice 
point with food on one side and a blind 
alley on the other. Briefly, I argued 
that after a number of trials the animal 
responded to the two paths with expec- 
tations, or surrogates, of food and dead- 
end, respectively; that since he was 
hungry the food surrogate was already 
aroused; that self-stimulation was there- 
fore stronger on the side toward food; 
and that strength of stimulus determined 
choice. This explanation raised two 
questions: (1) How was the food sur- 
rogate attached to hunger in the first 
place? (2) Aside from the two surro- 
gates could we be sure that total stimu- 


lation was stronger in the direction of 
food? Might not the frustration gen- 
erated by the dead-end surrogate pro- 
duce more “stimulus-intensity dyna- 
mism” (10) than would result from 
food anticipation? 

Guthrie would have a ready answer 
to the first question; as to the second 
he might hold that conditioned with- 
drawal responses would prevent entrance 
into the blind. But take the analogous 
case of a rat in a T with shock through 
the floor everywhere except in the goal- 
box. Suppose a non-correction method 
with removal from either endbox after 
30 seconds. Here there is no obvious 
goal surrogate to add stimulus intensity; 
rather the expectation that shock will 
continue is more excitatory than that it 
will cease. Moreover, responses to con- 
tinued shock in the wrong endbox prob- 
ably resemble responses at the choice 
point more closely than do those in the 
box without shock; the former should 
therefore be less likely to inhibit forward 
locomotion." 

In 1947 (23), with Hull’s principles 
(9) as a guide, I proposed what was es- 
sentially an elaboration of the earlier 
theory in an attempt to account for the 
facts of latent learning. In particular 
I applied the theory to Blodgett’s (1) 
experiment in which he introduced a 
food reward in a rectangular maze with 
one long and one short path to the goal- 
box. The sudden drop in errors was at- 
tributed to an abrupt increase of one 
factor in the food drive, a component 


1 Guthrie could still resort to finality through 
change of situation to explain learning under 
these conditions. But we have seen reason to 
doubt that this principle is sufficient by itself. 
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aroused by food itself, conditioned to the 
goalbox, and aroused as a food surrogate 
at the choice point. Since this factor 
was held to be stronger on the side 
nearer the goal, reaction potential and 
the probability of choice to that side 
were also greater. 

But although more dressed up, the 
theory was no less vulnerable than be- 
fore. Again we ask: What if, on the 
critical trial, instead of putting food in 
the goalbox Blodgett had shocked his 
rats throughout the rest of the maze? 
Since the drive surrogate would now be 
more strongly aroused by long-path cues 
we should have to predict fewer choices 
of the short one. The prediction is 
worth checking, but it is probably wrong. 

My next attempt to improve the the- 
ory (25) took the form of the following 
postulate: Reaction potential between 
S and R (sEp) is increased by the simul- 
taneous activation of the surrogate re- 
sponse to a satisfier (rsq). Certainly 
this proposition covered a wider range of 
conditions, but only through being too 
vague to be useful. Without a clear 
definition of a satisfier we are unable to 
use the postulate for prediction. For 
example, does rsg increase sEz in the 
absence of a relevant need, i.e., unless 
the organism is already set for the sat- 
isfier? A more precise statement of 
limiting conditions was called for. 

Such a statement was attempted in a 
recent discussion (26) of Hull’s revised 
postulate set (10). Here rsg, as a goal 
set, became a secondary motive differen- 
tially conditioned to choice point cues. 
Choice was determined when these cues 
facilitated the goal set. This-process I 
called tertiary motivation and proposed 
it as a substitute for secondary reinforce- 
ment with its habit-strengthening con- 
notation. 

Does the concept of tertiary motiva- 
tion meet the two-fold requirement of 
breadth and precision? Unfortunately 
not. It came from analysis of the goal- 
seeking aspect of behavior; application 
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to avoidance is awkward at best. Con- 
sider the accompanying diagram, which 
attempts to fit a typical appetite (food- 
hunger) and a typical aversion (pain- 
escape) into the proposed scheme of mo- 
tivation. For the appetite we can say 
that promotion of D, “reinforces” a re- 
sponse, but not for the aversion. And 
if “reinforcement” depends on enhance- 
ment of a goal set, then the reinforce- 
ment of an avoidant response calls for a 
D,! 








Motivation | Food-hunger 


Pain-escape 





Primary (D:) 
Secondary (D2) 
Tertiary (Ds) 


Hunger stimulus Pain stimulus 
Set to eat Fear 
Facilitated set Set to escape 





The gist of the problem can be stated 
as follows: In order to account for the 
discontinuities of behavior brought about 
by manipulating rewards I have made 
reinforcement affect performance rather 
than learning. But whichever a rein- 
forcer does, it is essentially a satisfier, a 
need reducer. How, then, can the an- 
ticipated reduction of a drive cause the 
increase of sEp necessary to response 
selection? * In positive cathexes involv- 
ing a characteristic consummatory re- 
sponse the increase of strength can be 
attributed to its surrogate. But in nega- 
tive ones, dominated by what the animal 
seeks to escape rather than attain, how 
does an organism avoid catastrophe? 

Two courses of action are possible: 
either to adopt one principle for appe- 
tites and another, such as Guthrie’s, for 
aversions; or to re-examine the nature of 
motivation in hope of finding a common 
mechanism. In this paper we choose the 
second course. 


STRUCTURE OF MOTIVES 


Motivation refers to those processes 
most essential to the initiation, mainte- 


2Hull resolved this dilemma by having 
drive reduction increase the habit-strength 
component of sEr. But this solution runs 
into difficulties, as elsewhere shown (26). 
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nance, and direction of activity. Of 
what use is a concept so broadly de- 
fined? This one is needed to account 
for the segmental character of behavior, 
the property that supplied Muenzinger 
(19) with a psychological unit of de- 
scription. An organism, as he pointed 
out, typically moves from a disturbing 
situation to one of relative quiescence. 
What Muenzinger calls a “start-to-end 
phase” we shall call a motivated act 
(M). 

A motive (m), the inner core of M, is 
harder to identify. Not directly observ- 
able, it has the status of a hypothetical 
construct in that it refers to a central 
neural process. It is equivalent to 
Morgan’s (17) concept of the central 
motive state, to which he assigned the 
properties of perpetuating itself, evoking 
general activity, and “priming” and 
emitting specific reactions. Through ob- 
served intercorrelations among instiga- 
tors, satisfiers, and intervening events 
specific ms can be identified and classi- 
fied. Our purpose is not to classify them 
but to describe their common structure. 

If central processes are to be handled 
by an S—R psychology they must be 
identified by the Ss arousing them or the 
Rs they lead to, or both. A convenient 
device for this purpose is the surrogate 
response (rs), elsewhere defined “on a 
molecular level . . . as a neural process 
occurring in the central connections be- 
tween S and R; on a molar level, as the 
functional equivalent of the whole S—R 
circuit” (24, p. 282). Since the essen- 
tials of the learning process take place 
in the brain and possibly in the spinal 
cord, it is reasonable to suppose that 
internuncial elements achieve some de- 
gree of functional autonomy; i.e., they 
can perform associative functions with 
greatly lessened external support. Thus 
the central counterpart of a response 
(perceptual, locomotor, emotional, or 
other) may be aroused in the absence of 
its original stimulus and in turn provide 
stimulation for associated responses. 
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Such a construct is especially useful in 
dealing with acquired motives and in 
deriving the “purposiveness” (29) of 
motivated acts. It does not, of course, 
rule out the probability that rs is of- 
ten supplemented by response-produced 
cues. 

We are now ready for a general de- 
scription of m. Let us start with a few 
typical examples. A hungry boy feels 
the pangs of an empty stomach and is 
the first to hear the chime of a distant 
ice cream truck. His lonely sister is 
more likely to hear the mail man or the 
telephone. A hiker caught in a down- 
pour thinks of a warm fire and dry 
clothes; on a hot summer day he yearns 
fora cool dip. If we can generalize from 
such cases it appears that most motives 
can be analyzed into two components, 
one associated with annoyers, the other 
with satisfiers. I suggest that we refer 
to these parts as moments of m and that 
we call the first moment drive and the 
second goal. They will shortly be de- 
fined as surrogate responses.® ‘ 

All ms do not lend themselves readily 
to description in these terms. Some 
seem to be all drive: some physical dis- 
comforts, the boredom of a solitary child, 
the paralyzing fear of a hunted animal. 
Others seem to consist entirely of goal: 
the desire to play, to climb a mountain, 
to see a movie, to eat candy after dinner. 
Such examples fall readily into the two- 
fold classification we have already bor- 
rowed from Craig via Tolman (29), viz., 
into appetites and aversions. An appe- 
tite may be defined as an m instigated, 
in part, by the absence of a certain 


8 What justification is there for endowing 
rss with properties of m? A deduction to 
this effect must rest on prior assumptions as 
to the nature of sEr and the conditions under 
which it becomes capable of prolonging itself 
and of priming and setting off other Rs. 
Since such speculations are fruitless at present 
we shall simply make the motivational status 
of the rs moments a first-order assumption 
and seek support in whatever verifiable de- 
ductions may follow. 
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source of stimulation and ended by re- 
sponding to it in a certain way. An 
aversion is an m instigated by the pres- 
ence of a certain stimulus source and 
ended by its absence. To decide whether 
aversions and appetites differ in basic 
structure or merely in emphasis we shall 
have to examine the part played by 
learning in their development. But first 
let me introduce a few more symbols 
with brief definitions of the concepts 
they stand for. 

S;—instigator: a stimulus pattern 
regularly followed by the onset of M. 

Sp—primary drive stimulus: an S, 
producing or produced by a homeostatic 
imbalance, e.g., a painful stimulus, empty 
stomach contractions, a dry throat. 

1Sp—surrogate drive stimulus; drive, 
for short: an rs initially aroused by Sp; 
the first moment constituting m. 

Srsp—secondary drive stimulus: a 
stimulus conditioned to rsp, therefore 
able to arouse it in the absence of Sp; 
e.g., a dentist’s drill, Culler’s buzzer. 

G—goal state: an inferred state of 
balance in the organism after M is over. 

Sa—primary goal stimulus: a collec- 
tive term for the inner and outer Ss 
entering into G. 

Re—primary goal response: a collec- 
tive term for the overt and covert Rs 
taking place in G. 

1Sg—surrogate goal response: an rs 
initially aroused as part of the neural 
circuit between Sg and Rg. 

R,—subgoal response: any R closely 
and consistently followed by G; eg., 
eating by a hungry organism. 

rsy—surrogate subgoal response. 

1Sq—TSq + Sg, + ° * + 1Sgn—Sur- 
rogate goal hierarchy; goal, for short: 
a central neural complex made up of 
goal and subgoal surrogates; th? second 
moment constituting m. 

Srsg—secondary goal stimulus: a 
stimulus conditioned to rsg, thus capable 
of arousing it before S, or G occurs; e.g., 
the sight of food, Pavlov’s tuning fork. 
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The problem of how motives are ac- 
quired may be dealt with under two 
main heads: (1) acquiring of goals; (2) 
acquiring of drives. 

1. Acquiring of goals. A goal, as de- 
fined above, is acquired through the con- 
ditioning of rsg to new aspects of the 
situation. These include both Sp and 
other Ss. By virtue of conditioning to 
rSp, tSq is shifted forward to the begin- 
ning of M and thus conditioned to still 
earlier Ss. In the same way rs,, such as 
the rs for eating or pressing a bar or 
entering a white box, is acquired. A well 
developed goal-moment thus consists not 
only of rsg but of a hierarchy of rs,s. It 
is for this reason that we need the in- 
clusive symbol rsg. 

Hull gave the classical account of this 
process in his 1931 paper (7), using the 
constructs of the fractional goal reaction 
and its proprioceptive cue. The relative 
prominence of rsg, and of certain sub- 
goals as compared with others, remains 
to be explained. Hull (8) supplemented 
his description by the concept of the goal 
gradient, according to which Rs are con- 
ditioned more strongly to Ss the closer 
they are to what we call G and: what he 
called a reinforcing state of affairs. To 
me it seems likely that the factors of 
finality and frequency are more funda- 
mental than reinforcement. Since G is 
always the final state superseding m, its 
surrogate rsq is in the ideal position for 
learning. By the same principles, sup- 
plemented by a postulate to be intro- 
duced below, the more closely and con- 
sistently an R, is followed by G the 
more frequently it will be made and the 
more strongly rs, will be conditioned.* 


*Our account parts company with that of 
Murphy (20), who calls goal-learning canali- 
zation and sets it apart from conditioning, 
and with that of Tolman (30), who distin- 
guishes among positive cathexes, positive 
equivalence beliefs, and field expectancies. 
Since this is not the place for a critical dis- 
cussion of viewpoints the present treatment is 
necessarily dogmatic. 
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Will the same description hold equally 
for appetites and aversions? One ap- 
parent distinction between them is that 
in appetites more than aversions one Ry 
is relatively fixed by nature for all mem- 
bers of a species and primed by some Sp 
or chemical agent. Although it is ques- 
tionable whether the R,s of eating, drink- 
ing, or copulating are more reflex than 
is withdrawing from a noxious stimulus, 
the generalization probably holds. But 
what of it? Does it mean that R,s 
culminating in a consummatory reflex 
will be more easily or stably learned 
than those without such a biological 
anchor? Actually learned avoidant re- 
sponses are notably persistent (2, 16) 
and most cases of abnormal fixation in- 
volve fear.° The chief significance of an 
innate R, is that the organism’s early 
trial-and-error behavior will be more 
limited in the event of certain cyclic dis- 
turbances than of adventitious ones,— 
an arrangement with obvious biological 
advantages. The important thing for us 
is that in both appetites and aversions 
the focusing of wants on specific satis- 
fiers must be learned and that the same 
learning principles seem to apply. 

2. Acquiring of drives. This process 
is envisaged as the conditioning of rsp, 
originally aroused by Sp, to other Ss; 
a simple contiguity principle seems ade- 
quate to account for it. Here we face 
the question: Can both appetitive and 
aversive drives be conditioned? Com- 
mon sense says yes. One road sign warns 
me of sudden death, another “makes me 
thirsty.” But we need more convincing 
evidence. 

So far it has been found much easier 
to condition fear in the laboratory than 
to condition hunger or thirst. One 
trouble with appetites is that to test for 


5It is interesting that what Maier (14) 
calls “behavior without a goal” may be used 
as a striking example of the tenacity with 
which an animal clings to a specific goal when 
caught in a “tight spot.” 
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rSp in the absence of Sp it is necessary 
to satiate the animal, thus producing a 
most unfavorable condition for testing. 
Several studies, however, have shown 
that secondary reinforcers based on hun- 
ger or thirst help animals maintain old 
habits or learn new ones even when 
satiated (3, 13, 28). If we assume that 
secondary reinforcers are effective only 
if they reduce some drive, these results 
imply that a conditioned drive is operat- 
ing. Increased hoarding by rats as a 
result of earlier frustration (11, 12) sug- 
gests a similar interpretation. 

Even if we grant that an appetite can 
function without Sp we are still not sure 
whether it is instigated by Srsp or Srsq. 
This doubt was settled for shock-avoid- 
ance by Brown and Jacobs’ (4) repeti- 
tion of Miller’s (15) classical study. 
But in an appetite the two moments are 
harder to isolate because of the early, if 
not innate, connection between Sp and 
R,. Until some method is devised it will 
probably make for theoretical simplicity 
to assume that the conditioned S,, in ap- 
petites as in aversions, is Srsp.* On this 
assumption the difference between them 
is reduced to one of degree. 

In summary, we may think of a mo- 
tive as a hypothetical construct made up 
of two moments, a surrogate drive stim- 
ulus (rsp) and a surrogate goal hier- 
archy (rsq) representing goal and avail- 
able subgoal responses. : These moments 
are integrated largely through learning, 
which consists of the conditioning of rsq 
to rsp and of each one to other Ss. Both 
appetites and aversions are held to con- 
form to this description. 


FUNCTION OF MOTIVES 


With a generalized description of a 
motive at hand, we are ready to make 


6 Mowrer (18) takes a similar position with 
his concept of “drive-fear.” The implications 
of Srse for a theory of functional autonomy 
of motives are intriguing but must be reserved 
for treatment elsewhere. 
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a start toward answering the question: 
how does it direct behavior? Since m is 
an intervening construct the question 
breaks down into two parts: (1) How 
do conditions affecting the organism 
change the functional characteristics of 
m? (2) How do these changes deter- 
mine the organism’s selection of re- 
sponses? 

In answer to part 1, the strength of 
each moment can presumably be raised 
by unconditioned and conditioned stim- 
uli and lowered by their removal. We 
must also recognize that the two mo- 
ments are so closely related that a 
change in one involves a change in the 
other. Thus, since rsqg is conditioned to 
rSp, its strength will vary as some posi- 
tive function of drive. On the other 
hand, in some cases Srsp may displace 
Srsq, thus reducing goal intensity. In 
the same way independent variation of 
rsq may react negatively on rsp, since 
R, and G are associated with the cessa- 
tion of drive. These secondary relations 


will not be considered in this preliminary 
treatment. 

As to part 2, there are a number of 
salient facts about behavior that seem 
to reflect the influence of motivation. 
One is that as the strength of drive in- 
creases the organism’s responses become 


more vigorous. This effect can be par- 
tially handled for some drives by the 
general energizing action of Hull’s pri- 
mary drive (D) considered as a chem- 
ical agent. But since certain Rs are ap- 
parently more sensitized than others a 
more specific mechanism is needed. For 
this purpose it may help to recall that 
m, as a central impulse pattern, func- 
tions both as R and as S. In the course 
of trial-and-error behavior both mo- 
ments become conditioned to successive 
Ss on the one hand and Rs on the other. 
To Hull’s postulate VI regarding stim- 
ulus-intensity dynamism (V) we may 
add a tentative assumption as to the V 
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of a motive (V,,). This assumption is 
that V,, is a linear function of the sum 
of intensities of rsg and rsp, i.e., 


Vin = a(rsg + rsp) + R. (1) 


It follows that increments in m will step 
up the sEp to any R conditioned to it. 

It is equally clear, however, that not 
all Rs conditioned to m are equally 
likely to be made, but that those lead- 
ing most directly to G have a decided 
edge. At first glance it may seem as if 
equation (1) will handle this fact, too. 
Since Ss closest to G are conditioned 
most strongly to rsq their Rs should 
command the largest V,,. A second 
glance shows that V,, does not neces- 
sarily follow a goal gradient. For while 
rs is raised by goal-pointing Ss, rsp 
may be equally raised by remote ones, 
so that both sets of Ss have the same 
effect on V,,. This difficulty is especially 
clear in the T-maze shock-escape prob- 
lem already considered. 

To predict goal-direction a further as- 
sumption is needed. We do not have far 
to seek. In view of the close integration 
of rsp and rsq, it would be surprising if 
they acted in complete independence. 
We therefore assume that V,, is.a func- 
tion not merely of their sum but also of 
their interaction. As a first approxima- 
tion I suggest that it be made secondar- 
ily a positive linear function of the alge- 
braic difference between rsg and r5p. 
Equation (1) takes the following re- 
vised form: 


Va _ a(rsq rSp) 


+ b(rsq — rsp) +h. (2) 


Algebraically this revision amounts to 
weighting rsg more heavily than rsp in 
determining V,,. 

Equation (2) seems to contain the es- 
sential ingredients of an adequate sub- 
stitute for the gradient of reinforcement 
without the embarrassments encountered 
by that construct. By means of the con- 
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cept of V,, as here defined we can handle 
the T-maze situation with ease, and with 
the aid of quantitative refinements we 
should be able to deduce the gradients 
of amount and delay of reward. Since 
G affects sEz by way of V rather than 
sH,» it should also be possible to explain 
sudden changes in behavior with the in- 
troduction, increase, or decrease of re- 
ward (27). 

One finding not included in the pres- 
ent theory is the “contrast effect” re- 
ported by Crespi (5) and Zeaman (31). 
These investigators found that when the 
amount of reward to which rats were 
trained was suddenly increased, the rats 
started sooner or ran faster than others 
trained to the larger amount from the 
beginning. Crespi also obtained a down- 
ward contrast effect by reducing the re- 
ward, but for Zeaman it was not signif- 
icant. Another example of downward 
contrast was observed by Elliott (6) in 
the maze performance of rats when he 
changed their reward from bran mash to 
sunflower seed. 

It is possible to derive this phenome- 
non by making one more extension of the 
formula for V,,—a refinement not too 
far-fetched in its own right. We may 
argue that if an increment in rsq relative 
to rsp raises V,,, the rate at which the 
increment occurs may have something to 
do with its effectiveness. The more 
rapid the increase the more V,, may be 
heightened. If this much be granted, 
then by the same token a sharp, uncom- 
pensated drop in rsq should lower Vy, 
more than a gradual one. On these as- 
sumptions we revise equation (2) as 
follows: 


Vn = a(rsq + rp) + b(rsq — rsp) 
+ c|d(rsqg — rsp)/dt| +k. (3) 


Applying this formula to Crespi’s and 
Zeaman’s results, we assume that, on the 
next trial after the augmented reward 
was found, starting box stimuli evoked 
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an rsq corresponding to the smaller 
amount superseded by an rsg to the 
larger. A rapid increase in rsq thus took 
place in the starting box. Theoretically 
the first two terms on the right-hand side 
of equation (3) brought the experi- 
mental animals to the level of the con- 
trols; the third term carried them above 
it. We also predict that as the earlier 
goal-trace became progressively weaker, 
the third term would approach zero and 
the E curve would drop back to the C 
level. So far no such study has been 
continued long enough to verify the pre- 
diction. Downward contrast is derived 
in the same way, ‘though why it should 
be less striking than upward contrast 
is not explained. Incidentally, it should 
be possible to demonstrate both effects 
by shocking two groups in a straight- 
away and varying the degree of shock 
reduction in the endbox. 

Further development, quantification, 
and testing of the theory must be left to 
the future. All that remains to be done 
now is to point out how the present 
formulation relates to the steps preced- 
ing it. The terms secondary and ter- 
tiary motivation have to be given new 
meanings for comparison with those in- 
dicated in the diagram above. Second- 
ary motivation now refers to rsp and rsq 
in so far as they are activated by condi- 
tioned instigators; its strength is in- 
cluded in equation (1). Tertiary mo- 
tivation was my attempt to single out 
the specific contribution to sEz of the 
goal as the crucial factor in response 
selection. That concept is now em- 
bodied in the last two terms of equation 
(3). It is still essentially what it was 
originally intended to be: a substitute 
mechanism for secondary reinforcement. 


SUMMARY 


An attempt has been made to correct 
certain shortcomings noted in my previ- 
ous efforts to solve the problem of rein- 
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forcement. A major concern was to de- 
velop a mechanism that would apply 
equally well to learning motivated by 
appetites and aversions. 

The present “solution” analyzes all 
motives into two main parts, or mo- 
ments, a drive (rsp) and a goal (rsq), 
instigated and integrated largely through 
conditioning. Their role in problem 
solving is envisaged as follows: 


1. In determining the stimulus-inten- 
sity dynamism of a motive (Vm), rSq is 
assigned greater weight than rsp. 

2. Ss and Rs near reward are condi- 
tioned more strongly to rsq than those 
more remote. : 

3. Goal-pointing Ss therefore generate 
the greater V,, and their Rs command 
the greater sEp. 

The theory is extended to provide for 
“contrast effects.” 
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In recent years psychologists! have 
come to be more and more interested 
in language and cue-producing re- 
sponses in general. Adherents of 
each of the major learning-theories 
are attempting to work out rationales 
adequate, it is hoped, to account for 
the learning of the complex linguistic 
responses which come to form part of 
the response-repertoire of most human 
beings living in social groups. It has 
been established, of course, that lan- 
guage is learned, and thus is a legiti- 
mate concern of the learning-theorist 
and other psychologists. Psycholo- 
gists’ studies of language necessarily 
involve dealing with the same subject 
matter that is the concern of the lin- 
guist, whose interest has been increas- 
ingly in the development of a rigorous 
system for the description and formal 
analysis of language. To be sure, lin- 
guists have occasionally and uncriti- 
cally adopted one or more of the cur- 
rent theories of acquisition, or con- 
cocted ad hoc explanations of language- 
acquisition to meet the requirement of 
the lectures on language-learning in 
an elementary class in linguistics. 
Some of these theories have unfortu- 
nately found their way into print. 


1We wish to express our gratitude to Dr. 
Donald J. Lewis for his many helpful com- 
ments, from the psychologist’s point of view, 
about the paper. Thanks are also due to Dr. 
Norman A. McQuown, and Dr. Samuel E. 
Martin, with whom the first-named author 
discussed some of the linguistic problems in- 
volved. Final responsibility for everything in 
the paper, however, rests with the authors. 
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However, this tendency has shown a 


marked decrease since Bloomfield 


pointed out twenty years ago ‘‘that 
we can pursue the study of language 
without reference to any one psycho- 
logical doctrine, and that to do so 
safeguards our results and makes them 
more significant to workers in related 


fields” (2, p. vii). In other words, 
the linguist is to devote himself to 
description and formal synchronic 
and diachronic analysis, irrespective 
of current theories as to how language 
is acquired. Insofar as the number of 
such ad hoc ventures has decreased, 
Bloomfield’s remark has been salu- 
tary ineffect. However, a too narrow 
interpretation of that remark can re- 
sult in closing off areas of joint re- 
search. In view of the careful experi- 
mental work and notable achievements 
in theory construction on the part of 
psvchologists and the recent advances 
in linguistic analysis, it may be that 
the time has come when the linguist 
and the psychologist can undertake 
some joint investigations with profit. 

Just as linguists have occasionally 
created or uncritically adopted the- 
ories of language-acquisition, so also 
have psychologists, in the course of 
their investigations of language-learn- 
ing and other matters, developed 
their own linguistic theories. Char- 
acteristic of these theories is the as- 
sumption of linguistic ‘“‘units’’ like the 
“sound,” ‘‘syllable,” ‘‘word,’’ and 
“sentence” as self-evident. They are 
nowhere defined in these theories. 
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As a matter of fact, linguists, after 
prolonged methodological  difficul- 
ties, have come to the conclusion that 
these ‘‘folk-units’” have no cross-cul- 
tural validity, that is to say, they can 
only be used by being redefined for 
each language described. For ex- 
ample, one would be hard put to it to 
discover comparable units in such di- 
verse languages as Yoruba, Annamese 
and Yaruro if the folk-unit “word” is 
employed as the basis of description. 
Even if defined separately for each 
language, the units called ‘‘words”’ in 
each of these languages might well 
not be comparable, since the different 
linguistic criteria employed in the 
definition might result in a polymor- 
phemic word for one language, whereas 
it might turn out that in a second lan- 
guage all words are monomorphemic. 
The implications of this lack of com- 
patibility are obviously of great im- 
portance for the psychologist. For 
example, a study, based on the use of 
the notion “word,” of the vocabulary- 
size of speakers of two languages might 
reveal great differences in word-count 
between them, whereas the actual 
number of learned discriminations 
might well be very nearly the same. 

In order to point out the difficulties 
that arise when psychologists make 
up their own linguistics, we turn to an 
examination of George Miller’s chap- 
ter, “Speech and Language,” in the 
recently-published Handbook of Ex- 
perimental Psychology (12). We sin- 
gled out this work for special consid- 
eration precisely because it appears in 
a standard handbook that will be 
widely used, represents a summary of 
work. accomplished and in progress 
rather than a narrowly individual 
contribution, and is at least as com- 
petently done as anything in the field 
with which we are acquainted.” 


2 We wish specifically to avoid the sugges- 
tion that our comments are singularly appli- 
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1. We find three kinds of difficulties 
with Miller’s chapter: those that con- 
cern particulars, those of general the- 
oretical import, and those having to 
do with bibliography. 

1.0. Difficulties that concern par- 
ticulars are, in turn, of three varieties: 
the factually false, the highly ambigu- 
ous, and the misleading. 

1.1. The factually false. We take 
it as understood that empirical or 
contingent propositions, because they 
are not analytic in character, may be 
said to be true or false with only a 
certain degree of probability. We 
believe that there is ample evidence to 
indicate that the examples we cite 
are false. We shall present a number 
of such factually false propositions 
for purposes of illustration. 

a. “One of these consonants, the 
glottal stop ?, is not used in normal 
English speech, but we should prob- 
ably add two more: t in choke, and 
dz in joke” (12, p. 795). Now we 
know of no dialect of English in which 
the glottal stop is not employed; the 
only reason it does not turn up in the 
frequency studies quoted by Miller 
is that these studies are based on the 
traditional orthography, and the glot- 
tal stop is not ordinarily written in 
any one consistent way in English. 
For example, some, perhaps most, 
American pronunciations of button 
[ba’?n], contain the glottal stop. 
The probability is high that every 
time George A. Miller says his name, 
“George A. Miller,”’ with emphasis, 
he utilizes this by no means absent 
consonant at the beginning of what is 


cable to any particular person; we address 
them rather to all students of language prob- 


lems. Since this paper was written, Dr. Mil- 
ler’s book, Language and Communication, has 
been published. It represents, in some re- 
spects, improvement over the chapter in the 
handbook, and, being an important work, de- 
serves detailed consideration on its own merits, 
at a length outside the scope of this paper. 
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written with the initial A. in the con- 
ventional orthography. 

In many dialects of American Eng- 
lish, morphemes written with an ini- 
tial vowel have two alternate phonetic 
shapes: One, occurring initially in an 
utterance, begins with a glottal stop; 
the other, in utterance-medial posi- 
tion, begins with the vowel.* 

With respect to the initial phonemes 
of choke and joke, they are either se- 
quences of /t/ plus /§/ and /d/ plus 
/z/ as Miller indicates, in which case 
they are not to be added to the list of 
phonemes, or, they are unit phonemes 
/t/ and /3/ (in which case they are 
not to be written with the symbols 
/t8/ and /dzZ/ which indicate conso- 
nant clusters, not unit phonemes). 
Such contrasts as scorching vs. court- 
ship make it necessary to regard the 
latter alternative as the more prob- 
able. In short, Miller has either im- 


properly analyzed or improperly em- 


ployed the initial consonants of choke 
and joke. 

b. “The classification of English 
vowel sounds is usually made in terms 
of the position of the tongue. In this 
way the back vowels of boot or book 
are distinguished from the front 
vowels in beet or bit’’ (12, p. 794). 
The classification of English vowels 
is made, as a matter of fact, in terms 
of tongue position and lip-rounding.‘ 
Boot contains not only a back vowel, 
but a rounded vowel, and not all 
back vowels are rounded, cf., for ex- 
ample, the vowel of Western New 
York fog, which is low back and un- 
rounded. 

Considerations of space prevent us 
from giving additional instances of 
factually false propositions. 


8 We wish specifically to avoid the problem 
of the phonemic status of [?]. For one treat- 
ment of the matter, and of a number of other 
linguistic complexities overlooked by Miller, 
see (16). 

+ Not to mention degree of tension, see (16). 


D. L. OtmstTep AND O. K. Moore 


1.2. The highly ambiguous. (a) 
“The strongest evidence for preferred 
sequences comes from the casual ob- 
servation that consonants and vowels 
tend to alternate in speech” (12, p. 
797). It is difficult to determine 
whether this statement is trivial, 
almost a tautology; for, on the as- 
sumption that within any given idi- 
olect there are consonants and vowels, 
variation in their occurrence is in- 
evitable. If, on the other hand, as 
seems more likely, Miller intends to 
suggest that utterances are composed 
of sequences of vowels and consonants 
such that two or more vowels or con- 
sonants do not occur together, then 
this flies in the face of the empirical 
evidence. If Miller had been making 
his “casual observation” in Polish- 
speaking territory, he might have 
noted a reverse tendency, since medial 
consonant clusters of nine consonants 
occur in Polish. To be sure, there 
are languages, e.g., Yoruba, which 
have no consonant clusters, but Eng- 
lish is not one of them. Since lan- 
guages exhibit such diverse structures 
with regard to this matter, it seems 
difficult to determine what could pos- 
sibly be meant by saying that vowels 
and consonants “tend to’ approxi- 
mate the CVCV form. 

(b) ‘‘As the child matures he em- 
ploys an increasingly wide range of 
sounds, and at 2.5 years the distribu- 
tion is very similar to that for adults’’ 
(12, p. 799). Without dealing with 
the unfortunately arbitrary age sug- 
gested in the second part of the above 
proposition, an age for which ade- 
quate cross-cultural validation has 
not been collected, we turn to the ex- 
pression “wide range of sounds.”’ It 
is unclear, and crucially unclear, 
whether Miller uses “‘sound”’ to refer 
to a phoneme or to a noise produced 
by a given articulatory act. If the 
latter, this seems not to be in accord- 
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ance with the findings of Leopold, 
(11) Velten, (17) Jakobson, (10) and 
Hockett, (9), who indicate that the 
babbling infant engages in a wider 
range of articulations than that of the 
adult, and that the number of different 
articulations decreases as the number 
of phonemic discriminations increases. 
In other words, the infant makes a 
great variety of noises that are not 
part of the language of his speech- 
community, and these, from the point 
of view of reinforcement theory, not 
being rewarded, are extinguished at 
the same time that the child gradu- 
ally develops new contrasts where 
there were none, thus increasing the 
list of his phonemes. On the other 
hand, the articulations of the adult 
have relatively high habit strength, 
so that the wide range of articulations 
possible for him when he was a bab- 
bling infant are now found to be diffi- 
cult when he attempts to learn a 
foreign language. 

1.3. The misleading. (a) In a dis- 
cussion pertaining to unit consonants, 
Miller states that certain ones “‘S, St, 
dz, Zz are seldom used in any position”’ 
(12, p. 797). Although it is very 
likely true that these phonemes and 
clusters are rare in English, it is mis- 
leading to group them together in a 
discussion of unit phonemes, since it is 
unclear whether dz represents a 
cluster or a unit phoneme in Miller’s 
scheme, and St is unambiguously a 
cluster. If the subject of clusters is 
to be broached at all, either directly 
or indirectly, then the distinction be- 
tween unit phonemes and clusters 
should be made, since it is well known 
that unit phonemes and clusters are 
not usually similar in pattern. 

(b) One of the most misleading 
features of the chapter has to do with 
the use Miller makes of the “‘word’’- 
lists of Dewey, Thorndike, and others. 
Many years ago Bloomfield discussed 
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such attempts to get at language 
through written sources: “If we take 
a large body of speech, we can count 
out the relative frequencies of phon- 
emes and of combinations of phon- 
emes. This task has been neglected 
by linguists and very imperfectly 
performed by amateurs, who confuse 
phonemes with printed letters” (2, p. 
136-137). The difficulty with using 
so-called “word”’-lists is that the 
orthography of English inaccurately 
and inconsistently reflects the phone- 
mic pattern and, unless one works 
with a phonemic analysis constantly 
at hand, gross inaccuracies of the 
type listed in 1.1 are inevitable. 
More important, traditional ‘‘word’’- 
lists, unless they are subjected to a 
morphological analysis, do not give 
anything like an accurate account of 
the basic linguistic ‘signalling units, 
the morphemes. It is perhaps not 
entirely fortuitous that the morpheme 
concept, one of the central concepts of 
modern descriptive linguistics, is not 
to be found in Miller’s chapter, or in 
most psychological studies of lan- 
guage. The somewhat extensive sta- 
tistical operations performed with 
such dubious data as “‘word’’-lists are 
consequently to be rated at something 
less than face value. Even Zipf, who 
is used as an authority by Miller, 
states, relative to Dewey’s word count, 
the same one that is used by Miller: 
“. . . these cannot be said to repre- 


sent any actually spoken language, 
nor was that the author’s intent. . 

Let us repeat again, that the present 
law of frequency can only be exactly 
demonstrated in an actually spoken 


dialect’’ (18) (italics ours). Fortu- 
nately, presentday linguists have at 
last turned their attention to quanti- 
tative analysis of actually spoken 
dialects;° and it is therefore no longer 
necessary to rely on “‘word’’—lists of 


5 Cf., for example (7, 15). 
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the kind utilized by Miller and others 
working in the same field. 

2.0. Difficulties of general theoretical 
import. There are a number of dis- 
tinctions that linguists, working with 
problems of the formal analysis of 
language in the last 100 years, have 
found it necessary tomake. Long ago 
linguists discovered that the orthog- 
raphies of those languages that are 
customarily written are usually im- 
perfectly related to the sound system 
of what is spoken. Therefore there 
are certain things that can be said of 
an orthography that may not be said 
of the utterances it is supposed to 
represent. This then, is a fundamen- 
tal and elementary distinction that 
all linguists, whether their concern be 
with historical problems or descriptive 
analysis, are agreed upon; it perme- 
ates the whole of linguistic science. 
Illustrative of the difficulties into 
which neglect of this distinction can 
lead one are those experienced by 
Newman in his article (14) dealing 
with the distribution of vowels and 
consonants in various languages. In 
working out the statistics, he finds it 
convenient to indicate consonants by 
1 and vowels by 0, and indicates that 
English the would be represented by 
110. Here is a classic example of the 
results of linguistic research being 
rendered invalid by confusion of let- 
ters in the orthography with the 
phonemes. For this utterance does 
not begin (phonemically) with /th/, but 
with /d/, this fact being obscured by 
the English-speaker’s custom of writ- 
ing /d/ with the two letters th, relying 
on knowledge of the language to dis- 
tinguish between what is represented 
by th in hothouse and other (not to 
mention what it represents in nothing). 
The utterance the in Newman's 
scheme would thus be 10, rather than 
110. Newman’s method of following 
the orthography must have led to 
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gross errors, if, as he indicates, he 
was interested in the language and 
not the orthography. For example, 
through would be in his system 
1110011, while #o would be 10, al- 
though phonemically they are, re- 
spectively, /@raw/ and /tiw/, and 
would thus be either 1100 and 100 or 
1101 and 101, depending on the 
status of /w/ as vowel or consonant. 
Moreover, forms like bough, cough, 
though, slough, would be similarly rep- 
resented, although different phonemic- 
ally, while forms like oh, sew, though, 
beau, hoe, owe, fro, faux pas, although 
phonemically alike, would be differ- 
ently represented. 

It is incumbent upon anyone work- 
ing in this general area to decide 
whether he wants to study orthog- 
raphies or languages, since there are 
important differences between the 
two. If any given study be so crude 
that it makes no difference if the re- 
sults for the one be taken for the re- 
sults for the other (something that 
could only be ascertained by doing 
the study both orthographically and 
phonemically), it is the researcher’s 
responsibility to point out the crudity 
of the results and to show further that 
the hypothesis that he was testing was 
likewise of sufficient crudity to justify 
using such gross methods. 

For the last half century linguists 
have been preoccupied with arriving 
at descriptive units adequate for any 
spoken language. Through a process 
of trial and error they have found that 
certain units are unworkable, while 
other units that have been redefined 
and explicated have been rendered 
cross-culturally valid. Typical of 
these units is the phoneme, for which 
the definitive work by Bloch (1) is 
only the culmination of generations 
of work by others, and the morpheme, 
given its present state of explication 
by such workers as Bloomfield (2), 
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Harris (4,5,6) and Hockett (8). It 
seems to us extremely unfortunate for 
psychologists to recapitulate the 
weary phylogeny of linguistic develop- 
ment with all its blind alleys, and 
fruitless controversies. The difficul- 
ties of the psychologists are likely to 
be compounded by virtue of the fact 
that their linguistic naiveté is overlaid 
with the protective coloration of im- 
pressive statistical procedures. 

To return to Miller’s chapter, we 
are told that ‘‘verbal behavior pro- 
ceeds word by word,” and that ‘‘the 
choice of the word as the unit in this 
process (the study of language) is not 
crucial, for the same thing can be done 
with the 26 letters of the alphabet and 
aspace.”’ For the linguist this option 
is like that between Scylla and Cha- 
rybdis, since the inapplicability of 
“letters” has been pointed out above, 
and the “word,” not a unit having 
cross-cultural validity, is a folk-unit 


apparently defined as whatever is 
written in the traditional orthography 
with spaces around it. 

There are a great many other im- 


portant theoretical considerations 
which we would like to treat in detail. 
Among these is the concept of ‘‘ver- 
bal context,” which Miller is at great 
pains to develop by means of ‘“‘sta- 
tistical approximations to English.” 
This, as a first attempt, is creditable, 
but unnecessary, since the notion was 
clearly worked out by Harris (5) a 
decade ago. Other considerations of 
this sort are Newman’s concept of 
“primitive languages’ (one now dis- 
carded by anthropologists and _ lin- 
guists), Miller’s assumption of the 
“syllable” as a valid linguistic unit, 
and his preoccupation with English, 
which leads him to fabricate general- 
izations which may well not prove to 
be the case when the evidence from 
other languages is in. 

Matters concerning bibliography 
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manifest something of a cultural lag 
of roughly twenty years with respect 
to matters linguistic. E.g., no im- 
portant linguistic work and no work 
relating to the theory of descriptive 
linguistics whatsoever bearing a date 
later than 1930 is cited. As a matter 
of fact, most of the important lin- 
guistic work that appeared earlier 
than that date is omitted, e.g., the 
work of Sapir. Those psychologists® 
who are interested in pursuing the 
matter further may refer to the bibli- 
ography of works dealing with lin- 
guistics in the excellent work by the 
psychologist Carroll (3). 

In summary we would suggest that 
inasmuch as psychologists have found 
it profitable to work with physiologists 
and inadvisable to invent their own 
physiology, so too we think there is 
much to be gained by a similar atti- 
tude toward linguistics, and we have 
prepared this paper in the interests 
of achieving that end. 
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AN ANALYSIS OF MEANING * 


BY CLYDE E. NOBLE ? 


State University of lowa 


INTRODUCTION 


Intimately related to the production 
of research data and to the formulation 
of theory in psychology is the procedure 
of identifying and quantifying the rele- 
vant variables within its various do- 
mains. Concerning the field of verbal 
learning, such writers as Carr (5), Rob- 
inson (24), McGeoch (22, 23), Dashiell 
(8), Melton (19, 20), and Underwood 
(28) have emphasized the continuing 
need for this type of analytic research. 

The analysis of the attributes of ver- 
bal material has, moreover, a more gen- 
eral application. The training of human 
perceptual and motor skills is often ac- 
companied by verbal instructions in- 
tended to facilitate performance on such 
tasks. One factor which may determine 
the effectiveness of instructions is the na- 
ture of the verbal stimuli which are in- 
troduced. For example, particular words 
may vary in meaningfulness. Evidence 
reviewed in such sources as McGeoch 
(23), Underwood (28), and Woodworth 
(31) indicates this to be a potential 


1 This report forms a part of a dissertation 
submitted to the faculty of the Department 
of Psychology of the State University of Iowa 
in partial fulfillment of the requirements for 
the Ph.D. degree, June 1951. The author is 
indebted to Prof. Kenneth W. Spence for his 
advice and criticism. A portion of this paper 
was read before the Midwestern Psychologi- 
cal Association, April 1951. 

The experimental work was conducted dur- 
ing the writer’s temporary appointment as re- 
search psychologist with the Human Resources 
Research Center during the summer of 1950. 
The opinions or conclusions contained in this 
report are those of the author. They are not 
to be construed as reflecting the views or en- 
dorsement of the Department of the Air Force. 

2Now at the Human Resources Research 
Center, Lackland Air Force Base, San An- 
tonio, Texas. 
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relevant variable in verbal learning. 
Historically, however, there has been 
little agreement on the precise definition 
of meaning, with the result that few con- 
sistent scaling procedures have been de- 
veloped with which its actual relevance 
may be evaluated. 

The objective of the present study is 
a theoretical-experimental analysis of 
the attribute of meaning in verbal stim- 
ulus material. Defining operations will 
be designed in accordance with rational 
considerations about this concept. In 
addition, quantitative analysis will pro- 
vide the scale values necessary to the 
discovery of accurate functional rela- 
tionships among this and other better- 
known psychological variables. 


An ANALYSIS OF MEANING 


The many problems of meaning have 
occupied the attention of philosophers 
and of psychologists for a long time. 
Some of these problems have been gen- 
uine, others spurious. Inasmuch as its 
necessary and sufficient operations are 
both logically possible and empirically 
feasible, it may be shown that at least 
one of these alleged issues constitutes a 
genuine problem. Such is the require- 
ment of an analysis of meaning in ver- 
bal learning theory.* 

Within the framework of Hull’s (14) 
behavior theory this is a relatively 
straightforward task. Consider a stim- 
ulus element S,, a class of conditioned 
responses R,, R,, R;, - + + Ry, anda 


8 For a set of criteria to determine the status 
of a given problem, cf. H. M. Johnson (16). 
It is of historical interest that Watson’s po- 
sition on the meaning issue in 1925 was that 
the term was then unnecessary but that, should 
the need arise, behavioristic definition and ex- 
planation could be given (29, p. 201). 
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class of corresponding habit strengths 
| a? oT Pe - H,, forming hypo- 
thetical bonds between them. Assume 
that these Rs have, by virtue of prior 
training, been connected at various times 
to S,, and that, for simplicity, the Hs 
of these connections are severally equal. 
This hypothetical situation may be rep- 
resented by the schema in Fig. 1, where 
the broken-shafted arrows denote learned 
connections, and where the dotted line 
following D denotes a continuing need 
or motivational state. It will be seen 
that this model depicts an ordinary com- 
peting response situation, in which each 
R has an equal probability of occurrence 
(R,) following the presentation of S,, 
and in which, given a wider range of ob- 


STIMULUS 
ELEMENT 


MEANINGS 
(=NO. OF gHp's) RESPONSES 
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servations, such phenomena as alterna- 
tion, blocking, and increased reaction 
latency (R;) are predictable (cf. 15). 
Should the Hs be altered considerably 
in value the principle of competition 
would still hold, except that to refer to 
the habit structure under such condi- 
tions one would use the term hierarchy 
of habits. 

Since, by logical anaylsis, meaning is 
a relation between terms, let us define 
the meaningfulness of this situation as 
the number of Hs subsisting between S 
and the several Rs taken together. More 
specifically, the particular meanings of 
S, are: H,, H., H;, - - * H,, and dif- 
ferent conceptual combinations of these 
Hs yield different numbers of meanings. 


ACQUIRED 





De e . " 7 


Fic, 1. 


Fite 


7 
i 


Schema illustrating the development of stimulus meaning. 
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In this definition the author presupposes, 
of course, that the system S—H-—R is iso- 
morphic with the system a-means-f. 

Various possible logical “meanings” 
of meaning—e.g., signification, denota- 
tion, connotation, equality, equivalence, 
definitional equivalence, material impli- 
cation, strict implication—are not at is- 
sue here. Throughout the present anal- 
ysis one must clearly and persistently 
distinguish between logical and psycho- 
logical notions about meaning; the 
former class of notions is conceptual 
(hypothetical), the latter empirical (cat- 
egorical). Further, no confusion should 
result from referring to relations be- 
tween S and R as psychological (empir- 
ical) meanings, since such relations are 
(a) purely empirical constructs, and (b) 
presently to be coordinated with an oper- 
ational index, m. 

The present analysis does not assert 
meaning and habit strength to be iden- 
tical concepts, although they have some 
common properties. Meanings are pos- 
tulated to increase in number not as an 
exponential growth function of the num- 
ber of particular S-particular R rein- 
forcements—as H in Hull’s theory—but 
rather as a simple linear function of the 
number of particular S-multiple R con- 
nections established. Now in terms of 
excitatory strength (£), where E= 
H-D, a specific “energized” meaning 
may best be regarded as an unspecified 
supraliminal value of effective excitatory 
strength (EF), where E=E-—J. To 
strengthen E beyond the value of the 
limen (ZL) required for reaction evoca- 
tion (R) may alter R,, Ra, Rn, or Rz, 
but the qualitative fact that S sometimes 
evokes R is unaltered. This is the psy- 
chological connotation of the assertion: 
S means R. 

From an historical point of view it 
may be interesting to note that the pres- 
ent analysis is formally analogous to 
certain notions advanced by the British 
philosophers of the 18th and 19th cen- 
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turies—especially by Berkeley and by 
James Mill. Later, from the standpoint 
of introspectional psychology, Titchener 
taught that meaning is the conscious 
context which, under certain conditions, 
accrues to a “core” of sensory or imag- 
inal content. This is his context “the- 
ory” of meaning, which Boring (2, pp. 
185, 408) has implemented by suggest- 
ing the principle of ‘accrual’ to be that of 
association; i.e., learning. In terms of the 
Titchener-Boring viewpoint, then, con- 
text (or associated content) == meaning. 
Boring has also attempted to describe 
Titchener’s doctrine in S—R terminology 
by identifying S with “core” and R with 
“context” (2, p. 588; 4, p. 18); hence 
with “meaning.” However, since they 
can be shown to state infeasible demands 
(cf. 16), these and allied considerations 
—such as whether meaning is “palpa- 
ble,” “unconscious,” or only “potential” 
—are of no scientific concern to modern 
(behavioristic) psychology. 

An interesting approach to a contex- 
tual theory of meaning at a more com- 
plex level of analysis is provided by the 
recent paper of Miller and Selfridge 
(21). Defining meaningfulness in terms 
of dependent probabilities in successive 
free-association observations, these in- 
vestigators have developed lists of vary- 
ing orders of approximation to the struc- 
ture of English. 

So much for the formal definition of 
the concept of psychological meaning in 
terms of habit. Like habit, meaning is 
here a purely empirical construct. In 
order to impart significance to this no- 
tion—i.e., to relate it systematically to 
other constructs in behavior theory—it 
is first necessary to exhibit certain oper- 
ations by means of which it may be 
given empirical verification. In other 
words, one must specify an empirical in- 
dex with which the formal concept of 
meaning may be placed in correspond- 
ence. A few such indices are already 
available in the field of verbal learning. 
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They are defined by the various opera- 
tions used for calibrating the “associa- 
tion values” of stimulus items. The 
work of Cason (6), Glaze (9), Haagen 
(11), Hull (13), Kreuger (18), and of 
Witmer (30) represent important con- 
tributions to this problem. However, 
most of these indices are unsatisfactory 
either because they involved (a) very 
short response intervals, (b) free associ- 
ation techniques, (c) relative frequency 
measures, or (d) because their reliabili- 
ties were not reported. Since theoreti- 
cally the number of Rs is proportional 
to the number of supraliminal Es, fre- 
quency of response is proposed as a 
rational index of stimulus meaning (m). 
Therefore, the appropriate association 
value for the present analysis would be 
denoted by the central tendency of the 
frequency distribution of continued as- 
sociations given by Ss per unit time.* 
Following these considerations an op- 
erational index of the attribute of stim- 
ulus meaning (m) was sought for each 
member of a list of 96 dissyllables, as 
indicated by the following definition: 


1 
m,=—)> R,, (1) 
N i=l 


where S= verbal stimulus; R= unit 
written response; N = number of sub- 
jects. 

Procedure 


A provisional list of 120 two-syllable 
nouns was taken from the Thorndike- 
Lorge tables (26), the principal selec- 


* Continued associations are those which are 
successively elicited by the same stimulus, as 
distinguished from free or controlled associa- 
tions. The present procedure is analogous to 
one reported by Cattell and Bryant (7) and 
called, apparently by Woodworth (31), the 
method of continued association. ‘ Krueger 
(18) later used written responses in deter- 
mining the association values of nonsense syl- 
lables, although the instructions to his Ss 
would seem to define their responses as free 
associations. 
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tion criterion being the G (general) fre- 
quency count. These items were drawn 
with the intention of representing (a) 
nearly all of the alphabet in the initial 
letters and (b) an extreme frequency-of- 
use range. It was hypothesized that fre- 
quency of occurrence in the written lan- 
guage would be highly correlated with m 
and therefore should provide a useful 
approximate ranking of the sample of 
stimuli to be calibrated. 

The words from the Thorndike-Lorge 
list were supplemented by 18 artificial 
words which were also dissyllabic and in 
the form of nouns. They were selected 
from Dunlap’s list (cf. 31) or invented 
by the author. The purpose of includ- 
ing these paralogs was to insure a low-m 
extreme on the final scale, as well as to 
calibrate such items empirically on a 
scale continuous with that of actual 
words. 

After a number of arbitrary and sys- 
tematic rejections, the final list was 
reduced to 96 items. This list con- 
tained approximately 20 per cent para- 
logs, 35 per cent infrequent items (< 1 
per 4 million), and 45 per cent fre- 
quent items (> 1 per million). The 
last two frequency classes are defined 
by their Thorndike-Lorge relative fre- 
quency counts indicated in parentheses. 
The number 96 was selected because it 
was associated with a convenient max- 
imum testing time for the prevailing 
military research schedules at the Hu- 
man Resources Research Center. The 
time interval of 60 sec. was chosen be- 
cause (a) preliminary tests showed that 
Ss reported 60 sec. to be an optimal in- 
terval, and (b) to insure a reliable time 
sample of the Ss’ response hierarchy. 

The stimulus items were administered 
in test booklet form with attached an- 
swer sheets. A uniform set was main- 
tained by printing only one stimulus per 
page and by instructing S to return to 


' the stimulus each time before respond- 


ing anew. Furthermore, a given stim- 
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ulus item was reproduced on each line 
in an effort to reduce S’s inveterate tend- 
ency to free-associate. The sequence 
and order of presentation of the stimuli 
were varied by shuffling the answer 
sheets during the assembly of the test 
booklets. This device served to min- 
imize constant errors due to fatigue, de- 
creasing motivation, and inter-item in- 
teraction. After administering a pilot 
list to 15 Ss, in order to standardize the 
procedural variables, the final list of 96 
items was given to a sample of 131 basic 
airmen from two flights undergoing rou- 
tine classification testing at the Human 
Resources Research Center. These Ss 
were group-tested in four separate units 
of approximately half-flight size (about 
33 men) in order to reduce inter-individ- 
ual interaction. This source of variance 
was further reduced by varying the order 
and sequence of stimuli per S, as in- 
dicated. Two examiners tested two 
groups each, and the testing periods were 
held during the morning hours of two 
days one week apart. Response periods 
were of 60 sec. duration per stimulus, 
with an inter-item interval of 15 sec. 
Rest periods were given as follows: 5 
min. at the end of the first 45 min. of 
testing, 10 min. at the end of the second 
45 min. period, and 5 min. at the end of 
the next 30 min. period. 

Instructions to the Ss were as follows: 


This is a test to see how many words 
you can think of and write down in a short 
time. 

You will be given a key word and you 
are to write down as many other words 
which the key word brings to mind as you 
can. These other words which you write 
down may be things, places, ideas, events, 
or whatever you happen to think of when 
you see the key word. 

For example, think of the word, KING. 
Some of the words or phrases which KJNG 
might bring to mind are written below: 
Kingdom 
England 
imperial 
kingfish 


queen 
King Cole 
ruler 

Sky-King 
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Ss were then given two practice ses- 
sions, using as stimuli the words HAM 
and KOREA. They were permitted to 
use two-word phrases, slang, long words 
or short words, provided they were as- 
sociates of the stimulus words. 

Instructions regarding motivation and 
set were as follows: 


No one is expected to fill in all the 
spaces on a page, but write as many words 
as you can which each key word calls to 
mind. Be sure to think back to the key 
word after each word you write down be- 
cause the test is to see how many other 
words the key word makes you think of. 
A good way to do this is to repeat each 
key word over and over to yourself as you 
write. 

E also gave supplementary motivating 
instructions during the three rest pe- 
riods. 

The method of recording S’s responses 
was sufficiently objective to require very 
little evaluation on E’s part. However, 
in terms of the analysis of meaning pro- 
posed, it was decided to set up three 
objective criteria for unacceptable re- 
sponses. These were: 


1. Illegtble responses: S, — ? 
2. Perseverative responses: 
S;— Ri(s:) — Ri(si)-+ 


, Ri R 
3. Failures of set: sK Fy, 
Ro(s2)— Re 

\ 


R 


2 

23 
This last class of unacceptable re- 

sponses was further classified into: 


(a) Free or tangential associations: 
e.g., LEMUR—Dorothy, Hope, 
faith, charity... . 

(b) Clang or alliterative associations: 
e.g., KAYSEN-— caisson, Casey, 
casein, casement. .. . 


Finally, a general rule of giving S the 
benefit of the doubt was adopted. This 
was occasionally necessary in the case of 
category 3 above, although free and 
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TABLE I 


List or DissyLLABLE Worps (NouNS) IN RANK ORDER OF INCREASING MEANING- 
FULNESS (m) AS DEFINED BY MEAN FREQUENCY OF CONTINUED 


ASSOCIATIONS IN 60 SEC 


(N = 119) 








Word 


Rank | Number 


| 
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24 
53 
49 
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4 
86 
77 
90 
41 
66 
25 
52 
96 
63 
73 
55 

6 
81 
88 
29 
40 
13 

3 
48 
12 
89 

7 
36 
46 
79 
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22 
19 
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20 
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26 
21 
11 
54 
43 
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GOJEY 


NEGLAN 
MEARDON 
BYSSUS 
BALAP 
VOLVAP 
TAROP 
XYLEM 
LATUK 
QUIPSON 
GOKEM 
NARES 
ZUMAP 
POLEF 
SAGROLE 
NOSTAW 
BODKIN 
ULNA 
WELKIN 
ICON 
KUPOD 
DELPIN 
ATTAR 
MATRIX 
DAVIT 
WIDGEON 
BRUGEN 
KAYSEN 
MAELSTROM 
TUMBRIL 
RENNET 
ROMPIN 
GAMIN 
FEMUR 
LOZENGE 
FERRULE 
STOMA 
GRAPNEL 
FLOTSAM 
CAROM 
NIMBUS 
LEMUR 
CAPSTAN 
PERCEPT 
LICHENS 
JETSAM 
ENDIVE 
TARTAN 








58 
72 
84 

5 
76 
60 
74 

1 
68 
35 
17 
59 
51 
62 
57 
94 
91 
67 
64 
15 
83 
18 
37 
38 
47 
42 
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30 
82 
92 
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10 
93 
23 
85 
31 
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27 
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14 
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OVUM 
ROSTRUM 
VERTEX 
BODICE 
TANKARD 
PALLOR 
SEQUENCE 
ARGON 
RAMPART 
JITNEY 
ENTRANT 
PALLET 
NAPHTHA 
PIGMENT 
ORDEAL 
ZENITH 
YEOMAN 
QUOTA 
QUARRY 
EFFORT 
UNIT 
FATIGUE 
KEEPER 
KENNEL 
MALLET 
LEADER 


| QUARTER 


REGION 
HUNGER 
ZERO 
INCOME 
UNCLE 
YOUNGSTER 
TYPHOON 
CAPTAIN 
ZEBRA 
GARMENT 
VILLAGE 
INSECT 
JEWEL 
JELLY 
HEAVEN 
OFFICE 
WAGON 
DINNER 
MONEY 
ARMY 
KITCHEN 
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clang associations were usually easily 
identified by the three scorers. Of the 
original 131 Ss tested, 12 protocols were 
rejected for persistent violations of the 
criteria cited. This brought the effective 
sample to 119 Ss. 


Results 


The index of meaning (m) of a par- 
ticular stimulus was defined in equation 
[1] as the grand mean number of (ac- 
ceptable) written responses given by all 
Ss within a 60 sec. period. Therefore, 
the scale values of the stimuli were de- 
termined directly by the average re- 
sponse frequencies of the 119 Ss. These 
m-values with the o’s of their distribu- 
tions are shown in Table I, ranging in 
rank order from dissyllables of low re- 
sponse-evocation value (e.g., No. 1: 
GOJEY) to those of high response-evo- 
cation value (e.g., No. 96: KITCHEN). 
The empirical range is from 0.99 to 9.61. 
It will be noted that there is no discrete 


gap between the paralog items and the 


actual words. In fact, there are a few 
actual words low on the scale (e.g., No. 
4: BYSSUS), while one paralog (No. 
32: ROMPIN) appears at the third- 
way point. It is also to be noted that 
response variability tends to increase 
with increasing m-value. 

It was found that the m-values of 
particular items were quite stable from 
group to group. Intercorrelations of the 
four sets of mean m-values per word 
were carried out among all six combina- 


TABLE II 


INTERGROUP RELIABILITY COEFFICIENTS (r) 
FOR m-SCALE BASED ON MEAN 
m-V ALUES FOR Four Groups or Ss 
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tions of groups. These Pearsonian r- 
values appear in Table II. All are sig- 
nificantly different from zero (P < 0.01). 
Since the sampling distribution of r is 
skewed for large values, Fisher’s Z-trans- 
formation was used to estimate the mean 
intergroup reliability coefficient of the m- 
scale: ?mm = 0.975. It may be pointed 
out that a between-groups reliability co- 
efficient ° is the appropriate statistic to 
compute in this case since it was E’s aim 
to determine the consistency of different 
response samples to the same stimuli. 
A more conventional reliability coefficient 
—such as one defined by the test-retest, 
split-half, or the alternate form proce- 
dure—would not have evaluated this par- 
ticular relationship. 

Of some interest in this investigation 
was the extent to which the assumptions 
of the product-moment correlational 
method were met. The family of re- 
sponse frequency distributions associated 
with the stimulus items exhibited skew- 
ness at the low-m extreme of the scale, 
but throughout the central and upper 
portions they were approximately sym- 
metrical. Hence, means were retained 
as measures of central tendency. When 
the six intercorrelations of the m-scale 
were plotted, it was found that the re- 
quirements of linearity of regression and 
of homoscedasticity were reasonably sat- 
isfied. 


DISCUSSION 


Meaning. After reviewing the anal- 
ysis of meaning, one properly may ask 
whether responses may acquire mean- 
ings also, or whether only stimuli do so. 
As has been indicated, meanings are 
considered relations between Ss and Rs.* 


5 Rather than a “reliability” coefficient, some 
might prefer to call this statistic a coefficient 
of “objectivity,” “agreement,” or of “consist- 
ency.” 

6 Not all writers would agree to construe 
meaning thus (cf. 2, 3, 4, 17, 27). Some of 
the divergences of opinion are reflected in the 
following successive quotations from Boring’s 








CLYDE 





7 
oo 





De » 
Fic. 2. 


It is for convenience that, instead of re- 
ferring to m, one speaks of “the mean- 
ing of a stimulus” or of “stimulus mean- 
ing,” just as one speaks of “reinforcing 
a conditioned response,” when more pre- 
cisely it is the S-R connection, or H, 
which strictly is reinforced. To speak 
of stimulus meaning is to imply an asym- 
metry in the empirical meaning relation. 
Indeed, common linguistic usage seems to 
concur that meaning, like causation, be 
regarded as a property of stimuli rather 
than of responses.’ 

Under certain conditions, however, it 
is appropriate to refer loosely to the 
meaning of a response. One such condi- 
tion would arise if analysis should in- 
dicate that a certain class of responses 
results in proprioceptive stimulation (s) 
1933 text (3): “The correlation between stimu- 
lus and ultimate response is a meaning . . .” 
(p. 153); “. . . the data of consciousness are 
meanings” (p. 222); “. . . a meaning is a re- 
lation” (p. 222); “Meaning is response” (p. 
223). 

7 This is not to be interpreted as bearing 
any relation to the Gestalt doctrine of mean- 
ing as immediately given in the external world 
(cf. 17), but simply as a clarification of a 
familiar idiom. 
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Schema illustrating the development of more complex degrees of meaning. 


to an organism. This is the well-known 
response-produced stimulus situation, or 
feedback mechanism. Kinesthesis is per- 
haps the best example. The descriptive 
schema outlined in the section on mean- 
ing applies equally well, as shown in 
Fig. 2. Here the situation becomes more 
complex, but no different qualitatively. 
Hs develop between initial R (—s)s and 
subsequent Rs, thereby permitting more 
complex degrees of development of 
meaning. 

The serial anticipation learning situa- 
tion, for example, fits this schema well 
in that each successive response func- 
tions as a stimulus to the next response 
in the series, while the verbal stimuli 
appearing serially in the memory drum 
aperture serve as secondary reinforcing 
agents. This type of analysis also sug- 
gests an explanatory approach for the 
relationships Miller and Selfridge (21) 
have found between reproductive recall 
and contextual dependencies. The work 
of Thorndike (25) on “belonging” may 
be similarly regarded. 

The result of this analysis of mean- 
ing and its incorporation into learn- 
ing theory is twofoid: (a) it establishes 
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a highly reliable, unequivocal new at- 
tribute of variation in learning, and 
(b) it provides an operational basis 
for explicating the common-sense no- 
tion of “meaning.” Thus, if one were 
to ask a layman what he intended by 
saying that “home” to him means: “fam- 
ily, spouse, children, friends, love,” etc., 
he would doubtless reply, “I think of 
these things when ‘home’ is mentioned.” 
It is a simple matter to fit this statement 
to the model proposed in Fig. 1. A 
learning theorist would explain that to 
the auditory (or visual) S home, these 
various verbal Rs have become condi- 
tioned during our imaginary layman’s 
previous experience, and that under ap- 
propriate conditions (e.g., adequate D 
level, sufficient reinforcements to each 
L) these Rs are elicited. The meaning 
of S subsists in the Hs developed to it 
—nothing more.’ A neutral S, by the 
present definitions, is meaningless; an 
S conditioned to twenty Rs is more 
meaningful (i.e., has more meanings) 
than is one conditioned to ten, and so 
on. Speaking quite non-technically, 
meanings are habits. And as more hab- 
its accrue to a particular stimulus situa- 
tion, so does its meaningfulness increase. 

In the final analysis the index m, like 
H, emerges as a Statistical concept. It 
is a function of the number of particular 
S-multiple R connections which are 
formed, and it enjoys an existence in- 
dependent of the cited operations no 


®In view of the fact that the class of re- 
sponses defining the m-scale represents a set 
of individual-difference variables, one should 
properly denote the meaning relation in this 
case by the symbol U rather than by H. 
From a genetic standpoint, certain learning 
theorists preserve a distinction between innate 
or previously-acquired connections (sUr’s) 
and laboratory-established connections (sHr’s). 
However, in Hull’s theory both U and H are 
considered habit or associational concepts, 
hence the proposed coordination with meaning 
is unimpaired. A similar argument holds for 
conditioned generalized connections (sHr’s). 
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more than does any other empirical con- 
struct. 

In view of its theoretical status and 
exceptional reliability, the m-scale is re- 
garded with especial interest for research 
in verbal and in perceptual-motor learn- 
ing. Using the m-scale, research may 
now be directed toward the solution of 
such current problems as the relation- 
ship between difficulty and meaningful- 
ness, the effect of meaningfulness upon 
reminiscence, and the réle of verbal in- 
structions in the acquisition of motor 
skills. 


SUMMARY AND CONCLUSIONS 


This paper has presented a theoreti- 
cal-experimental analysis of the attri- 
bute of meaning in verbal stimulus mate- 
rial. A word list of 96 dissyllables 
consisting of nouns and paralogs was 
presented to a sample of 119 USAF re- 
cruits in order to establish a quantitative 
scale for this attribute. The results of 
this analysis were as follows: 

1. Meaning was formally defined as a 
relation between S and R. It was co- 
ordinated with Hull’s theoretical con- 
struct H by postulating that meanings 
increase as a simple linear function of 
the number of S-multiple R connections 
acquired in a particular organism’s his- 
tory. 

2. An index of stimulus meaning (m) 
was operationally defined in terms of the 
mean frequency of continued written as- 
sociations made by subjects within a 60- 
sec. time interval. 

3. A psychological performance scale 
of m-values was developed which exhib- 
ited a range extending from 0.99 to 9.61. 
The mean product-moment intergroup 
reliability coefficient Was fim, = 0.975. 

4. The significance of these findings 
for human learning theory was discussed. 


1 
REFERENCES 
1. BercmMann, G., & Spence, K. W. The 


logic of psychophysical measurement. 
PsycHou. Rev., 1944, 51, 1-24. 





430 





. Bortnc, E. G. A history of experimental 
psychology. New York: D. Appleton- 
Century Co., 1929. 

The physical dimensions of con- 
sciousness. New York: D. Appleton- 
Century, 1933. 

Sensation and perception in the 
history of experimental psychology. 
New York: D. Appleton-Century, 1942. 
. Carr, H. A. Psychology: A study of 
mental activity. New York: Long- 
mans, Green, 1925. 

. Cason, H. Specific serial 
study of backward association. 
Psychol., 1926, 9, 195-227. 

. Catrect, J. McK., & Bryant, S. Mental 
association investigated by experiment. 
Mind, 1889, 14, 230-250. 

. Dasurett, J. F. A neglected fourth di- 
mension to psychological research. Psy- 
CHOL. Rev., 1940, 47, 289-305. 

. Graze, J. A. The association value of 
non-sense syllables. J. genet. Psychol., 
1928, 35, 255-269. 

. GuimtForp, J. P. Psychometric methods. 
New York: McGraw-Hill, 1936. 

. Haacen, C. H. Synonymity, vividness, 
familiarity, and association value rat- 
ings of 400 pairs of common adjectives. 
J. Psychol., 1949, 27, 453-463. 

. Hess, D. O. The organization of behav- 
ior. New York: John Wiley & Sons, 
Inc., 1949. 

. Hutt, C. L. The meaningfulness of 320 
selected nonsense syllables. Amer. J. 
Psychol., 1933, 45, 730-734. 
Principles of behavior. 
Appleton-Century, 1943. 
Elementary theory of individual be- 
havior. (In preparation.) 

. Jounson, H. M. Are psychophysical 
problems genuine or spurious? Amer. 
J. Psychol., 1945, 58, 189-211. 

. Konter, W. The place of value in a 
world of facts. New York: Liveright, 
1938. 


learning: a 
J. exp. 


New York: 


18. 


19. 


31. 


. Roprnson, E. S. 


.—, & Lorce, L 


. Torman, E. C€. 


CrLypEe E. Nose 


Kruecer, W. C. F. The relative difficulty 
of nonsense syllables. J. exp. Psychol., 
1934, 17, 145-153. 

Metton, A. W. The methodology of ex- 
perimental studies of human learning 
and retention: I. The functions of a 
methodology and the available criteria 
for evaluating different experimental 
methods. Psychol. Bull., 1936, 33, 305- 
394. 

——. Learning. In W. S. Monroe (Ed.), 

Encyclopedia of educational research. 

New York: Macmillan, 1950, 668-690. 


. Miter, G. A., & Setrrince, J. A. Verbal 


context and the recall of meaningful 
material. Amer. J. Psychol., 1950, 63, 
176-185. 


. McGeocu, J. A. The vertical dimensions 


of mind. Psycnot. Rev., 1936, 43, 107- 

129. 
——. The psychology of human learning. 
New York: Longmans, Green, & Co., 
1942. 
Association theory to- 
day: An essay in systematic psychology. 
New York: Century, 1932. 


. THORNDIKE, E. L. Human learning. New 


York: Century, 1931. 

The teacher's word 
book of 30,000 words. New York: 
Columbia Univ. Press, 1944. 

Purposive behavior in 
animals and men. New York: Cen- 
tury Co., 1932. 


. Unperwoop, B. J. Experimental psychol- 


ogy. New York: Appleton-Century- 


Crofts, Inc., 1949. 


. Watson, J. B. Behaviorism. New York: 


Norton & Co., 1925, 2nd Ed. 


. Witmer, L. R. The association value of 


three-place consonant syllables. J. genet. 

Psychol., 1935, 47, 337-359. 
Woopwortn, R. S. Experimental psy- 

chology. New York: Holt, 1938. 


[MS. received September 4, 1951} 





THE ROLE OF OBSERVING RESPONSES IN 
DISCRIMINATION LEARNING ‘* 


Part I 


BY L. BENJAMIN WYCKOFF, JR. 
University of Wisconsin 


Theorists in the area of discrimina- 
tion learning have often had occasion 
to refer to a set or predisposition of S 
to learn differential responses to a par- 
ticular pair of stimuli. Such a pre- 
disposition has often been attributed 
to some reaction of S such as an at- 
tending response, orienting response, 
perceiving response, sensory organiza- 
tional activity, etc. To implement 
the discussion of the role of such re- 
actions in discrimination learning we 
shall adopt the term “observing re- 
sponse” (R,) to refer to any response 
which results in exposure to the pair 
of discriminative stimuli involved. 
The probability of occurrence of an 
observing response will be denoted by 
po. These responses are to be dis- 
tinguished from the responses upon 
which reinforcement is based; that is, 
running, turning right or left, lever 
pressing, etc., which, for convenience, 
we shall term “effective responses.” 

Spence (19) has proposed a theory 
of discrimination which is specifically 
intended to deal with situations where 
no observing response is required of S, 
that is to say, to situations in which S 
is certain to be exposed to the dis- 
criminative stimuli on each trial or 
prior to each effective response (p, = 
1). The fact that in some discrimina- 
tion experiments this condition has 
not been satisfied has become an issue 


1 This paper is submitted in partial fulfill- 
ment of the requirements for the degree of 
Doctor of Philosophy, in the Department of 
Psychology, Indiana University. The writer 
wishes to express his appreciation to Dr. C. J. 
Burke for his invaluable guidance and stimu- 
lation. 
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in the literature, largely because it 
became necessary to delimit clearly 
the situations to which Spence’s 
theory is intended to apply. 


Spence’s theory of discrimination states 
that stimulus-response connections are 
strengthened or weakened during discrimi- 
nation training in essentially the same way 
as these changes would occur during condi- 
tioning or extinction. When a response is 
reinforced the connections between it and 
all aspects of the stimulus situation im- 
pinging on S at the time the response oc- 
curred will be strengthened. These connec- 
tions will be weakened when the response 
is not reinforced. Certain implications of 
this theory were questioned by Krechevsky 
(11) and other theorists, and became the 
subject matter of the “continuity-disconti- 
nuity” controversy. This material has been 
reviewed a number of times (2, 5) and 
need not be repeated in detail here. One 
aspect of the controversy is pertinent to 
the present discussion. Krechevsky (12) 
presented experimental findings which indi- 
cated that rats learned nothing with respect 
to two stimulus patterns during the first 20 
trials of a discrimination experiment even 
though they were systematically reinforced 
for approaching a particular pattern dur- 
ing this interval. Failure to learn was es- 
tablished by showing a lack of interference 
when Ss were tested on a reversed dis- 
crimination. These findings were in appar- 
ent disagreement with the data obtained by 
McCulloch and Pratt (13) in a similar ex- 
periment in which differing weights were 
used as discriminative stimuli. Here in- 
terference was obtained, indicating that 
some cumulative learning had occurred in 
the early portion of the experiment. 

In interpreting these results, Spence (20, 
p. 277) argued that the stimuli (patterns) 
used by Krechevsky were not sufficiently 
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conspicuous to provide a legitimate test of 
his theory. He suggested that Ss had not 
learned to orient toward the stimuli within 
the first 20 trails. He points out that in 
such cases, “. . . the animal must learn to 
orient and fixate its head and eyes so as to 
receive the critical stimuli.” He then sug- 
gests a way in which this learning may 
occur. “These reactions are learned... 
because they are followed within a short 
temporal interval by the final goal re- 
sponse.” 

This interpretation was put to an experi- 
mental test by Ehrenfreund (5). In his 
experiment the likelihood of S’s receiving 
the critical stimuli was manipulated by 
changing the position of the stimuli (up- 
right and inverted triangles) with respect 
to the landing platform of’a’ jumping stand. 
The design of the experiment was essen- 
tially the same as Krechevsky’s. The re- 
sults conform to Spence’s interpretation. 
When the stimuli were placed relatively 
high, no learning occurred within the first 
40 trials, whereas when the stimuli were 
placed closer to the landing platform learn- 
ing did occur. Learning was again meas- 
ured in terms of interference in the learn- 
ing of a subsequent reversed discrimination. 


The analysis of discrimination situ- 
ations in which some observing re- 
sponse is required is of interest for 
several reasons. First, discrimination 
learning in situations other than labor- 
atory experiments, such as human 
learning in the course of every day 
events, is largely of this kind. Sec- 
ondly, even in the most closely con- 
trolled laboratory experiments it is 
seldom, if ever, possible to say with 
certainty that S is exposed to the dis- 
criminative stimuli prior to each effec- 
tive response. In the case of pattern 
discriminations it has been demon- 
strated by Ehrenfreund (5) that rela- 
tively small differences in the position 
of the discriminative stimuli will 
effect discrimination learning, indicat- 
ing that relatively precise fixation of 
the stimulus is required. 

In the present paper an attempt 
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will be made to develop a more ex- 
tensive theory of discrimination which 
will include situations in which some 
observing response (hereafter referred 
to as R,) is required before S is ex- 
posed to the discriminative stimuli. 
An example of such a situation would 
be an experiment in which stimulus 
cards were placed overhead. In this 
case the response of raising the head 
would be the R,). 

If we accept the notion that changes 
in p. can be accounted for within the 
framework of reinforcement learning 
theory, it should be possible to devise 
a theory of discrimination which will 
include those cases where some R, is 
necessary. The purpose of this paper 
is to outline such a theory. We shall 
see that by analyzing discrimination 
learning in this way it will be possible 
to account for stimulus generalization 
and also changes in generalization dur- 
ing discrimination learning without 
postulating any direct interaction be- 
tween stimuli. Several hypotheses 
will be derived from this theory which 
have been tested in an experiment by 
the author presented in detail else- 
where (22). Finally we shall outline 
a way in which the present theory can 
be integrated with existing quantita- 
tive theories of conditioning and ex- 
tinction to form a quantitative theory 
of discrimination. 

To simplify this discussion let us 
consider a hypothetical experiment 
using a situation similar to that used 
by Wilcoxon, Hays, and Hull (21), 
and later used by Hull (10) for a dis- 
crimination experiment. In this ex- 
periment a rat was placed in a small 
compartment with a_ single exit 
through a door into a goal compart- 
ment. A measure of the latency of 
the response of running through this 
door was obtained. The discrimina- 
tive stimuli consisted of a black or a 
white door, either one of which was 
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present on each trial. During dis- 
crimination training the running re- 
sponse was reinforced with food when 
one color was present, whereas rein- 
forcement was withheld when the 
other color was present. Each stimu- 
lus was present on an average of 50 
per cent of the trials. 

For purposes of the present dis- 
cussion let us consider a slightly differ- 
ent situation in which the discrimina- 
tive stimuli are placed overhead 
rather than directly in front of S. In 
this case an observing response, 
raising the head, will be necessary if 
S is to be exposed to the discrimina- 
tive stimuli. On each trial, when S is 
placed in the apparatus, there will be 
a certain probability that the R, of 
looking up will occur. When R, does 
occur S will be exposed either to a 
black or a white card. When the R, 
fails to occur S will not be exposed to 
either card, but rather to a neutral 


population of stimuli (walls, floor, 


etc.). Note that in this situation S 
does not improve its chances of ulti- 
mate reinforcement by making the R,. 
The food is placed in the goal com- 
partment whenever the white card is 
present whether S actually looks up 
or not. Ina sense then, S gains only 
information by making the R.. 

We are now in a position to examine 
the relation between observing re- 
sponses and stimulus generalization. 
In general it is apparent that if p, has 
a low value, S will seldom be exposed 
to the discriminative stimuli (the 
black and white cards). S therefore, 
will have minimum opportunity to 
learn discrimination or to manifest 
any discrimination already learned. 
On the other hand, if p, has a high 
value, the opportunity to learn or 
manifest discrimination will be large. 

Stimulus generalization between 
two stimuli is usually defined either 
in terms of S’s tendency to respond 
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similarly to the two stimuli, or in 
terms of failure to learn differential 
responses readily. Thus we can see 
that stimulus generalization will de- 
crease as p, increases. 

If we assume that p, changes as a 
result of learning processes we can see 
that these changes would give rise to 
changes in generalization between the 
stimuli involved. More specifically, 
if we assume that p, will increase dur- 
ing discrimination learning (differen- 
tial reinforcement), generalization be- 
tween the discriminative stimuli will 
decrease. Similarly, we might as- 
sume that p, will decrease if we intro- 
duce a procedure in which the subject 
is reinforced equally often in the pres- 
ence of either stimulus (non-differ- 
ential reinforcement). This decrease 
in p. would give rise to an increase in 
generalization between the stimuli. 

In the case of the hypothetical ex- 
periment suggested above, generaliza- 
tion will be shown in a “‘crossover”’ 
effect between positive and negative 
trials. Reinforcements on positive 
trials (positive stimulus card present 
but not necessarily observed) will 
tend to strengthen the effective re- 
sponse on negative trials, while unrein- 
forced responses on negative trials will 
tend to weaken the effective response 
on positive trials. If S’s tendency to 
look up increases during differential 
reinforcement, this ‘“‘crossover”’ effect 
will decrease. If during non-differ- 
ential reinforcement the tendency to 
look up decreases, the “crossover” 
effect will increase. 

It should be emphasized that these 
statements regarding increases and 
decreases in p, are, at this point, as- 
sumptions which may or may not be 
true in a particular experimental situ- 
ation. We shall present experimental 
findings which suggest that these as- 
sumptions are quite generally true 
below. 
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In the above discussion we have 
considered the effects of R, on dis- 
crimination and generalization. At 
this point we turn our attention to the 
problem of accounting for changes in 
p. within the framework of reinforce- 
ment learning theory. Our problem 
will be to identify possible reinforcing 
conditions which may account for in- 
creases in p, during differential rein- 
forcement. 

First we note that, by definition, 
the observing response results in ex- 
posure to a pair of discriminative 
stimuli. If exposure to these stimuli 
is in some way reinforcing, we shall 
expect p, to increase or remain high. 
The problem at hand is to show how 
exposure to discrinfinative stimuli 
may have a reinforcing effect under 
the condition of differential reinforce- 
ment, while the same stimuli do not 
have this effect under the condition of 
non-differential reinforcement. Re- 
inforcement theory provides two ways 
of accounting for this reinforcing 
effect. 

The first method is the mechanism 
suggested by Spence when he states 
that observing responses are learned 
“because they are followed within a 
short temporal interval by the final 
goal response” (19). This mechanism 
will operate in experiments such as a 
“jumping stand’’ experiment, in 
which exposure to discriminative stim- 
uli may serve to increase the prob- 
ability of prompt reinforcement, that 
is to say, the probability of the “cor- 
rect’’ jump may be increased. Spence 
offered this suggestion in relation to a 
jumping stand experiment. 

The second method of accounting 
for the reinforcing effect is by appeal 
to the principles of secondary rein- 
forcement. Here we suggest that the 
discriminative stimuli themselves take 
on secondary reinforcing value during 
the course of discrimination learning. 
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It has been demonstrated that an origi- 
nally neutral stimulus which accompanies 
reinforcement may acquire secondary re- 
inforcing properties. That is, it may serve 
to strengthen a response upon which it is 
made contingent. Skinner (18, p. 246) 
has demonstrated that whenever a stimulus 
becomes a discriminative stimulus for some 
response in a chain leading ultimately to 
reinforcement, this stimulus will serve as a 
secondary reinforcing stimulus. The con- 
ditions necessary for the formation of sec- 
ondary reinforcing properties are further 
considered by Notterman (16), Schoenfeld 
et al. (17) and Dinsmoor (4). They point 
out that in all cases where secondary rein- 
forcement has been demonstrated, the con- 
ditions were also appropriate for the estab- 
lishment of the stimulus in question as a 
discriminative stimulus. They suggest that 
this may be a necessary (as well as suffi- 
cient) condition for the establishment of 
secondary reinforcing properties. In the 
present formulation it is apparent that the 
positive stimulus is presented in the ap- 
propriate temporal position to become both 
a discriminative stimulus (for the effec- 
tive response) and a secondary reinforcing 
stimulus (for the observing response). 


This mechanism may operate in 
any situation whatever where an R, 
is involved, since it is a defining char- 
acteristic of the R, that it leads to ex- 


posure to discriminative stimuli. 
Specifically it should apply to the 
hypothetical experiment suggested 
above. Here the effective response 
(running) will always be reinforced 
when S is exposed to the white card. 
Hence the white card could be ex- 
pected to acquire secondary reinforc- 
ing value. It is not sufficient to show 
simply that the positive stimulus will 
acquire secondary reinforcing value. 
We must also consider two other 
factors. First, R, results in exposure 
to the positive stimulus only 50 per 
cent of the time. It results in ex- 
posure to the negative stimulus the 
other 50 per cent. Second, the run- 
ning response is reinforced sometimes 
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when S is exposed to the neutral 
stimulus population, since, on positive 
trials, the running response is rein- 
forced even though S does not look 
up. The effective response is rein- 
forced most consistently when S is 
exposed to the positive stimulus. 
Therefore, it is still plausible to 
postulate that the intermittent ex- 
posure to the positive and negative 
stimuli will have a net reinforcing 
effect on Ro. 

It is true of both of these mecha- 
nisms that, before any increase in pp. 
can be expected to occur, S must learn 
differential effective responses, that 
is to say, S must learn to respond 
differently to the two discriminative 
stimuli. In the case of the ‘jumping 
stand”’ experiment, if S does not have 
differential jumping tendencies to- 
ward the discriminative stimuli, the 
probability of reinforcement will al- 
ways be 50 per cent, and will not be 
improved by the occurrence of Ro. 

When we apply the secondary rein- 
forcement principle we can see that 
the positive stimulus must appear in 
the proper temporal relation to rein- 
forcement a number of times before 
this stimulus will acquire secondary 
reinforcing properties. In terms of 
Notterman, Schoenfeld, and Dins- 
moor’s interpretation it will be nec- 
essary for S to learn differential effect- 
ive responses to the discriminative 
stimuli before secondary reinforcing 
properties are acquired by these 
stimuli. 

In view of these considerations we 
introduce the following general hy- 
pothesis: Exposure to discriminative 
stimuli will have a reinforcing effect 
on the observing response to the ex- 
tent that S has learned to respond 
differently to the two discriminative 
stimuli. 

Hereafter we shall refer to the 
magnitude of the difference between 
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Ss’ tendencies to respond to the two 
discriminative stimuli as the ‘‘degree 
of discrimination.” 

Earlier it was pointed out that the 
probability of occurrence of R, is one 
of the factors determining the rate of 
formation of discrimination. Accord- 
ing to the present hypothesis the op- 
posite relationship is also true. The 
resulting picture is one of a circular 
interrelationship, in which R, affects 
the formation of discrimination be- 
cause of its effect on exposure to dis- 
criminative stimuli, while the degree 
of discrimination affects R, through 
another mechanism involving either 
secondary reinforcement or changes 
in the probability of reinforcement. 

We now present four propositions 
which are implied by this general 
hypothesis. The hypothesis was 
formulated partly on the basis of 
experimental evidence already avail- 
able, which suggested that these 
propositions were true (22). At pres- 
ent we shall consider them as specific 
hypotheses. The first two of these 
have already been introduced as as- 
sumptions. 


1. p, will increase (or remain high) 
under conditions of differential rein- 
forcement. 

2. p. will decrease (or remain low) 
under conditions of non-differential 
reinforcement. 


It is apparent that these hypotheses 
are consistent with the general hy- 
pothesis since the degree of discrimi- 
nation will tend to increase (or remain 
high) under differential reinforcement, 
while it will tend to decrease (or 
remain low) under nondifferential 
reinforcement. In other words, S 
will learn to respond differently to the 
two stimuli under differential rein- 
forcement, but will learn to respond 
in the same way to them under non- 
differential reinforcement. Additional 
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hypotheses of interest can be derived 
from this general hypothesis. 

3. When a well established dis- 
crimination is reversed p, will de- 
crease temporarily and then return to 
a high value. 

We shall expect this change in p, 
because, following a reversal, the de- 
gree of discrimination will decrease 
as the original discrimination van- 
ishes. It will then increase as the 
new discrimination is formed. 

4. If at some point in an experiment 
the degree of discrimination is low and 
at the same time ?, is low (but greater 
than zero), we shall expect the forma- 
tion of discrimination to be retarded 
for some interval, but finally to occur 
quite rapidly. 


This hypothesis arises from the fact 
that increases in the degree of dis- 
crimination, and increases in pp», are 
dependent upon each other. Early in 


the process S will be exposed to the 


discriminative stimuli only a small 
proportion of the time and hence the 
degree of discrimination cannot in- 
crease rapidly. At the same time p. 
will not increase because of the low 
degree of discrimination. Then, as 
the degree of discrimination becomes 
sufficiently great to bring about an 
increase in p, the entire learning proc- 
ess will be accelerated. 


Krechevsky (11) presents data obtained 
in discrimination experiments in a jumping 
stand situation which correspond in some 
respects to the predictions of the pres- 
ent formulation. Curves for individual Ss 
show relatively abrupt discrimination for- 
mation. In general the curves also show 
a slight improvement in discrimination 
prior to the abrupt change. A curve pre- 
sented for discrimination reversal shows a 
rapid decrease in the degree of discrimina- 
tion to a chance level, followed by an in- 
terval during which improvement was much 
less rapid. Finally the process accelerated 
as the reversed discrimination formed. 
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Krechevsky also noted that during the in- 
terval while S was responding approxi- 
mately according to chance with respect to 
the discriminative stimuli, he showed a 
strong position preference. These findings 
artodaecciaplete agreement with hypotheses 
3 and 4 in the present formulation. 


The four hypotheses presented so 
far were tested in an experiment by 
the writer (22) which is presented in 
detail elsewhere. In this experiment 
direct measures of an R, were obtained 
during differential reinforcement, non- 
differential reinforcement and dur- 
ing discrimination reversal. Pigeons 
were used in a Skinner-box situation 
in which the effective response was 
striking a single translucent key. 
The discriminative stimuli were col- 
ored lights (red and green) projected 
on the back of the key one at a time. 
The colored lights were withheld and 
the key was lighted white until the 
R, occurred. The R, consisted of 
stepping on a pedal on the floor of the 
compartment. The reasons for using 
this response as an observing response 
are discussed in detail elsewhere (22). 
Here it will suffice to say that this re- 
sponse falls within our definition of an 
observing response in that it resulted 
in exposure to the discriminative 
stimuli. As in the case of the hy- 
pothetical experiment discussed 
above, the observing response had no 
effect on the probability of reinforce- 
ment at any given moment. 

All of the above hypotheses were 
supported by the results of this ex- 
periment. Concerning the first three 
hypotheses, p, was higher under differ- 
ential reinforcement than under non- 
differential reinforcement. When Ss 
were shifted from differential to non- 
differential reinforcement a marked 
decrease in p, occurred. All of these 
differences were significant at a 5 per 
cent level of confidence or better. 

The fourth hypothesis does not ap- 
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ply unless at some point in the experi- 
ment the degree of discrimination and 
p. are both low. This condition was 
not satisfied consistently since the 
operant (or base) level of the pedal 
response turned out to be relatively 
high for Ss. However, in several 
cases this condition was satisfied and 
in these cases the results conformed 
to the hypothesis. 

We can now illustrate some ways 
in which this theory might be useful 
in interpreting behavior in other ex- 
periments. 


1. If this theory is applied to situ- 
ations in which more than one pair of 
discriminative stimuli is involved we 
can make some predictions regarding 
changes in the readiness of S to form 
discriminations based on some par- 
ticular pair of stimuli. 

2. It has been demonstrated that 
when a discrimination is reversed re- 
peatedly Ss tend to learn the reversed 
discrimination more and more rapidly 
(15, 8). According to the present 
theory, during discrimination reversal 
the observing response is partially 
extinguished and __ reconditioned. 
Thus, during repeated reversals, the 
R, is, in effect, reinforced intermit- 
tently. Studies of intermittent rein- 
forcement have indicated that when a 
response is intermittently  extin- 
guished and_ reconditioned, the 
strength of the response tends to at- 
tain a relatively constant high value 
(18). On the first reversal p, might 
drop to a low value, and recover 
slowly, but with repeated reversals 
we would expect this drop to become 
less prominent, and finally, p,. would 
remain high throughout the reversal. 
It is apparent that if p, remained 
high, a reversed discrimination would 
be learned more rapidly than other- 
wise. 

In the preceding discussion we have 
examined some of the ways in which 
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discrimination learning may be af- 
fected when some observing response 
is required of S. We shall now derive 
some quantitative statements to sup- 
plement the above analysis. We 
shall attempt to set down the relation- 
ships involved in such a way that the 
present theory can be readily inte- 
grated into existing quantitative the- 
ories of learning such as Hull’s (9), 
Estes’ (6) or Bush and Mosteller’s 
(3). The potential applications of 
this development could proceed along 
two different lines. 

First, we could attempt to state the 
relationships between observing re- 
sponses and measurable aspects of the 
effective responses in such a way that 
Pp. could be estimated in situations 
where direct measurement of R, is 
not feasible. This might be the case, 
for example, if the R, involved focus- 
ing of the eye. If we apply the pres- 
ent development in this way, p. 
would become an intervening vari- 
able, which could be used to account 
for and predict behavior in situations 
where (1) the apparent generalization 
between stimuli changes, or (2) where 
the ease of formation of discrimination 
changes as a function of training. 
Berlyne (1) suggests that ‘‘attention”’ 
be treated in a similar way. 

Secondly, we could predict dis- 
crimination learning functions by 
adopting some set of assumptions re- 
garding the component learning pro- 
cesses involved. These assumptions 
could be adopted from some existing 
theory which treats the simpler proc- 
esses of conditioning and extinction. 
The main obstacle to this endeaver at 
the moment is the absence of any 
quantitative function for predicting 
changes in p.. However, we shall 
be able to set down the relationships 
involved in such a way that any ac- 
ceptable function can immediately be 
inserted. 
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QUANTITATIVE ANALYSIS 


For purposes of this analysis let us 
return to consideration of the hypo- 
thetical experiment discussed above. 
There it was pointed out that we must 
take into consideration three different 
stimulus populations which may effect 
Ss’ behavior. We shall adopt the fol- 
lowing notation to represent these 
stimuli. Let S, represent the stimu- 
lus population to which S is exposed on 
trials when the R, occurs and when 
the positive stimulus card (white) is 
present, S. represent the stimulus 
population on trials when the R, oc- 
curs and when the negative stimulus 
card (black) is present, and S; the 
stimulus population to which S is 
exposed when the R, fails to occur. 

In this analysis we shall use the 
symbol p to represent the probability 
of occurrence of the effective response 
at any given moment during a trial. 
This variable can be related to the 
variable of response latency as follows. 
Estes (6) has shown that if a response 
can be expected to occur with a given 
probability at any momnet during a 
trial, the mean latency of the response 
will be proportional to the reciprocal 
of the probability; that is to say, 
L = k/p, where L is the mean latency, 
p the probability, and k a constant of 
proportionality which will depend on 
the units of measurement used. In 
the present case we must consider the 
probability of occurrence of the effect- 
ive response for each of three stimulus 
populations. Let us adopt the sym- 
bols p1, p2, and ps to represent the 
probability of occurrence of the effect- 
ive response when S is exposed to S;, 
S2, and S3, respectively. We shall 
also wish to refer to the net probabil- 
ity of occurrence of the effective re- 
sponse on a given trial, taking into 
account that S may be exposed to 
different stimuli during the trial de- 
pending on the occurrence or non-oc- 


currence of the R,. We shall use the 
symbols p, and p_ to represent the 
net probability on trials when the 
positive or negative stimuli are pres- 
ent. 

To summarize: 


S, = the population of stimuli to 
which S is exposed if (1) the 
positive stimulus is present and 
(2) the R, occurs. 

=the population of stimuli to 
which S is exposed if (1) the 
negative stimulus is present 
and (2) the R, occurs. 
the population of stimuli to 
which S is exposed if the observ- 
ing response fails to occur. 
the probability that the effect- 
ive response will occur at any 
given moment during a trial 
(= k/L) 
the value of » when S is ex- 
posed to S; 
the value of » when S is ex- 
posed to Sz 
the value of p when S is exposed 
to S; 
the net value of / for a trial on 
which the positive stimulus is 
present 
the net value of p for a trial on 
which the negative stimulus is 
present 
the probability of occurrence of 
R, at any given moment during 
a trial. 


We shall now express certain func- 
tional relationships among these vari- 
ables. First we shall express p, and 
p— as two functions of the variables 
Pi, po, ps, and po. py and p_ are 
variables which can be evaluated 
from experimental measures, such as 
latency of the effective response, with- 
out reference to direct measures of 
R.. They correspond to the meas- 
ures of response tendency usually ob- 
tained in discrimination experiments. 
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However, in the present framework 
ps, and p_ are assumed to be the net 
result of the operation of the variables 
pi, P2, ps, and p,.. Our task will be to 
express this dependence as a pair of 
functional relationships. This can be 
done as follows. 

Consider a selected moment during 
a positive trial. At this moment S 
will be exposed to either S;, with a 
probability of ~., or to S;, with a 
probability of (1 — p.). If S is ex- 
posed to S; he will make the effective 
response with a proabability of )). 
If the effective response and R, are 
independent of each other the prob- 
ability that both R, and the effective 
response will occur will be the product 
pipe. If S is exposed to S; he will 
make the effective response with a 
probability of p3, and the probability 
that both will occur will be the prod- 
uct (1 — p.)p3. The total probabil- 
ity that the effective response will 
occur at this moment will be the sum 
of these products. Thus: 


b+ = Pohit (1 — po) ps (1) 


By exactly parallel reasoning with 
respect to a selected moment during 
a negative trial we obtain: 


p- = Popa + (1 7 Po) p3- (2) 


The next step will be to derive ex- 
pressions for predicting the values of 
pi, Po, and ps3. The reinforcement 
contingencies for the effective response 
in the presence of S;, Se, and S; can 
be readily ascertained. It will be 
possible to predict changes in the 
values of p1, P2, and p; on the basis of 
learning functions for the simpler 
processes of conditioning and extinc- 


tion if we assume that learning with° 


respect to each of these stimuli, pro- 
ceeds independently of learning with 
respect to the others. This assump- 
tion implies that interaction between 
stimuli will have a negligible effect. 
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However, in making this assumption 
we do not forfeit the ability to handle 
stimulus generalization within the 
present framework, since, as we have 
already pointed out, stimulus general- 
ization can be accounted for without 
postulating any such direct interac- 
tion. 

In the present paper we do not 
adopt a particular set of functions for 
conditioning and extinction, but at- 
tempt to set down the relationships 
in such a way that any acceptable set 
of functions can be immediately in- 
serted. 

The assumption of “negligible di- 
rect interaction” implies that changes 
in the probability of occurrence of 
the effective response with respect to 
a particular stimulus population S; 
(¢ = 1, 2, or 3) will occur only during 
the time in which S is exposed to S;, 
and that the rate of change with 
respect to time will depend on: 


1. Whether or not the effective 
response is reinforced. 
2. The value of p; at the time. 


If we let r; represent the proportion 
of the time during which S is exposed 
to S;, the rate of change of p; can be 
approximated by two functions as 


follows: 
dp;/dt = rf.(pi) (3) 


if the effective response is reinforced, 
and 


dp;/dt = 7 f-(pi) (4) 


if the effective response is not rein- 
forced. 

The functions f. and f, represent 
any acceptable set of analytic func- 
tions which approximate the rate of 
change of probability of occurrence 
of an effective response during condi- 
tioning and extinction, respectively. 
It will be noted that if we assign a 
value of 1 to r we will obtain expres- 
sions for simple cases of conditioning 
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or extinction. In the present model 
the values of r; can be expressed as 
functions of p. as follows. The posi- 
tive and negative stimuli are each to 
be present 50 per cent of the time. 
During this time the subject will be 
exposed to S; or S; with a probability 
of po. Hence: 


% = SPo 


"n= 


S will be exposed to S; with a prob- 
ability of (1 — p.). Hence: 


7g = (1 _ Po). 


We also know that all effective re- 
sponses in the presence of 5S, are rein- 
forced, effective responses in the 
presence of S, are not reinforced, and 
effective responses in the presence of 
S; are reinforced an average of one- 
half of the time. Using the above 


values of r and appropriate functions 
for reinforced and non-reinforced re- 
sponses we obtain: 


dp,/dt 
dpe dt = 
dp;/dt 


(5) 
(6) 


SPofe(pr) 
SPofe(P2) 


(1 at Po)fe(Pa) 
+ .5(1 — po)fe(ps). (7) 


We can now outline the steps which 
would be necessary to predict p, and 
p— (measurable aspects of effective 
responses) if we can predict the values 
of p. as a function of time. Such a 
function could be derived empirically 
or through some theoretical state- 
ment regarding the factors which 
bring about changes in p.. If p. can 
be expressed as a function of time we 
can rewrite equations 5, 6, and 7 to 
obtain expressions involving only 
dp,, dt, p; and t. If these differential 
equations can be solved we will ob- 
tain p; = f(t). Thus we can obtain 
values of pi, po, ps, and p, for any 
point in time. These values can be 
substituted in equations 1 and 2 to 
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give the desired prediction of p, and 
p-. 

On the other hand if we wish to 
estimate the values of », from known 
values of p, and p_, we can proceed 
as follows. 

Equations 1 and 2 state: 


b+ = Pohit (1 — po)ps, (1) 
p- = PoP2 + (1 = Po) P- (2) 


Differentiating with respect to time 
we obtain: 


dp,/dt = p.(dpi/dt)+pi(dp./dt) 
+(1— pe) (dp;/dt) — p3(dp./dt), 


dp_/dt= p.(dp2/dt) + p2(dp./dt) 
+(1—p.)(dps/dt)—ps(dp./dt). (9) 


Substituting values for dp,/dt, dp2/ 
dt and dp;/dt from equations 5, 6, and 
7 and rearranging terms we obtain: 


dp,/dt = pe e(P1) 
+.5(1—po)*Lfe(Ps) +fe(Ps) ] 
+(pi-—ps3)(dp./dt), 


dp_/dt=.5p2fe(p2) 
a 5(1 —- po)*Lfe(Ps) +f.(ps) ] 
+(p2—ps)(dp./dt). (11) 


Equations 1, 2, 10, and 11 represent 
four simultaneous equations. By 
combining these equations we can 
express 1, p2, and p,; as functions of 
the other variables and obtain a 
single expression: 


dp./dt - G(p+, p-, 
dp,/dt, dp_/dt, po), 


where the function G will depend on 
the functions f. and f. adopted for the 
conditioning and extinction functions. 

Now, if the curves representing the 
values of p, and p_ are determined 
experimentally, we can express these 
variables as analytic functions of time. 
We can also obtain expressions for 
dp,/dt and dp_/dt as functions of time. 
Substituting the functions for 4, 


(8) 


(10) 


(12) 
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p_, dp,/dt and dp_/dt in equation 12 
we obtain: 


dp,/dt = G'(t, po). (13) 


If this differential equation can be 
solved we obtain: 


Po = fo(t). (14) 


This equation will give us the 
desired value of », for any point in 
time during the experiment. 


SUMMARY 


In many discrimination learning 
situations some response, such as an 
orienting response, will be required of 
S before he is exposed to the dis- 
criminative stimuli. We call these 
responses “‘observing responses’’ (R,), 
and indicate their probability of oc- 
currence as p>. Increases in p, will 
result in increased exposure to the dis- 
criminative stimuli, and hence in- 


creased opportunity for S to learn or 


manifest discrimination. Decreased 
p. will have the opposite effect. 
These results are operationally equiv- 
alent to decreases or increases in 
stimulus generalization between the 
discriminative stimuli. The follow- 
ing general hypothesis regarding 
changes in p, can be derived from the 
principle of secondary reinforcement. 

Hypothesis: Exposure to discrimi- 
native stimuli will have a reinforcing 
effect on the observing response to the 
extent that S has learned to respond 
differently to the two discriminative 
stimuli. 

From this general hypothesis we 
derive the following specific hypothe- 
ses: 


1. p. will increase (or remain high) 
under conditions of differential rein- 
forcement (discrimination training); 

2. p. will decrease (or remain low) 
under conditions of nondifferential 
reinforcement; 
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3. when a well established discrim- 
ination is reversed, p, will decrease 
temporarily and then recover; 

4. If the degree of discrimination 
and p, are both low, the formation of 
discrimination will be retarded for 
some interval but will finally occur 
quite rapidly. 


Evidence in support of these spe- 
cific hypotheses was obtained in an 
experiment in which an R, was meas- 
ured directly. 

This formulation may be useful for 
interpreting behavior in cases where 
changes in generalization between 
stimuli occur, and where the ease of 
formation of discrimination on the 
basis of some particular set of stimuli, 
changes as a function of training. 
Ss learn reversed discriminations more 
and more rapidly if reversals are pre- 
sented repeatedly. The present for- 
mulation offers a relatively simple and 
readily testable interpretation of this 
phenomenon. 

This formulation lends itself to pre- 
cise quantitative statement. A quan- 
titative analysis could be used in two 
ways: (1) to make quantitative pre- 
dictions of behavior based on some 
set of theoretical statements regard- 
ing the component learning processes, 
and (2) to evaluate p, from observa- 
tions of measurable aspects of effective 
responses. The steps required for 
such an analysis are outlined. 
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THE MEASUREMENT OF DISCRIMINATIVE BEHAVIOR * 
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Psychologists make experiments in 
order to record observations of be- 
havior. Not every observable fea- 
ture of behavior is recorded, but a se- 
lection is made which is determined 
by the purpose of the experiment. 
The experimenter is concerned not 
only with observations but also with 
some theory or theories of behavior. 
His observations have meaning in 
terms of, and only in terms of, theory. 
The purpose of an experiment is to 
gather meaningful data. 

A theory of behavior is a structure 
which specifies relations between ob- 
servable data and some set of hypo- 
thetical entities which, whether they 
are conceived of as observable or un- 
observable, are, in fact, unobserved. 
A theory is written in terms of vari- 
ables, and its applicability depends 
upon the possibility of making infer- 
ences from the data of observation to 
the values of the variables. When 
the relation between data and the- 
oretical variables is loose or ambiguous 
we call the data an indicator for the 
variable; when the relation is strict 
and unambiguous we say the data 
are a measure of the variable. 

The development of measures is a 
part of theory. The selection and 
therefore the very collection of data 
is dependent upon measures or indi- 
cators. It follows, then, that it is not 
in general possible to collect large 
bodies of data at random and then 
construct a reasonable theory. The 
data that are collected depend upon 


1The work in this paper was done while 
the writer held an appointment as University 
Fellow in Psychology at the University of 
California at Los Angeles. 


the theoretical reasons for which they 
are collected. The development of 
appropriate measures and of adequate 
theory must go hand in hand. 
Almost without exception psycho- 
logical experiments have resulted in 
data which bear the indicator relation 
to the variables of the theories they 
were designed to test. Of necessity 
this has been the case, so no condem- 
nation is in order. But the task of 


providing measures remains and be- 
comes more and more pressing as psy- 
chological theory grows in scope and 
improves in definition. 

Psychologists have employed many 
different types of data as bases for 
assertions about what is theoretically 


the same variable. There is seldom 
reason to question the relevance of the 
data to the theoretical question at 
hand, yet it is a fact that different 
proposed measures of the ‘‘same”’ vari- 
able often lead to conclusions at vari- 
ance with one another. Since ma- 
terial of this conflicting sort exists, 
one way to clarify the situation and to 
move toward the development of true 
measures is to analyze the logical 
character of the indicators which have 
been used and bring into clear view 
the relations among them. 

A particular problem which exem- 
plifies the above situation arises in the 
theory and measurement of discrimi- 
native behavior. If discriminative be- 
havior is observed in two different 
situations, the two sets of observations 
cannot be said to measure, in any satis- 
factory way, the learning that occurs, 
unless a logical basis for comparing 
the measures can be provided. When 
discrimination is studied with paired 
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presentation of the stimuli and at an- 
other time with successive single pres- 
entation of the stimuli, usually differ- 
ent types of observation are taken. 
There seems to be no way to, obtain 
comparable measures of the strengths 
of the response tendencies to the two 
stimuli across different methods of 
presentation. 

We shall show how this impasse can 
be resolved. This paper will analyze 
measures of discrimination learning 
by using a psychological interpreta- 
tion of a formal logical structure. By 
means of this technique of logical 
analysis, important conclusions can 
be derived concerning certain aspects 
of discriminative behavior and a solu- 
tion can be given for an important 
instance of the problem of the com- 
parability of measures obtained in 
differing situations. This result will 
be an important step toward the 
achievement of true measures of 
learning. 

The tool we shall employ is a logical 
form of the theory of probability 
which permits both mathematical 
and logical operations within the same 
calculus (2). The psychological inter- 
pretation of this probability calculus 
identifies probability as the limit of 
the relative frequency of response to 
opportunity for response. With this 
definition it is obvious that the most 
commonly reported measure of be- 
havior in discrimination problems, 
proportion of trials correct, is a relat- 
ive frequency and hence an empirical 
estimate of a probability. An ex- 
perimenter records this relative fre- 
quency because he takes it as an in- 
dicator of the strength of a response 
tendency. It should be noted that 
employing this procedure is independ- 
ent of current theoretical predelic- 
tions; that is to say, it is done whether 
the psychologist calls the underlying 
variable a readiness, a reflex strength, 
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a reaction potential, or some other 
construct. It should be noted further 
that although measures like propor- 
tion of trials correct are very com- 
monly used, their theoretical, and 
especially their logical foundations, 
have not been analyzed as such. It 
is to this problem that the present 
paper is directed. 


THE THEORY OF BEHAVIORAL 
PROBABILITIES 


The assumptions and deductions 
which comprise the elements of our 
theory of behavioral probabilities fol- 
low. First, however, we give the 
definitions of the symbols which will 
be needed for the development of the 
theory. 


A = p; the situation in which 
the animal is placed to 
start each trial. 
ps any responses by the 
animal which leave it in 
the situation A (including 
the lack of any observable 

___ response). 

= the approach response to 
the discriminative stimu- 
lus which carries the ani- 
mal out of the situation A 
(read B as “not B’’). 
the probability that, start- 
ing from the situation A, 
the response B occurs. 


The symbols A and B designate 
classes of events, and the symbol B 
designates the complement class of 
class B. The symbol P is a functor 
taking classes of events as arguments 
and having a numerical value. Thus, 
the expression P(A,B) = p says: the 
probability of the behavior B in the 
situation A has the numerical value 


p 


In formulating the necessary prob- 
ability statements we shall need the 
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following further symbolism: A dot, 
., between two class symbols indicates 
the logical product of the classes, i.e., 
A.B includes those events which are 
included both in A andin B. A hook, 
v, between two class symbols indi- 
cates the logical sum of the classes, 
i.e., A vB includes those events which 
are included either in A or B, and pos- 
sibly, but not necessarily, included 
both in A and in B. We sometimes 
need, also, a means of indicating the 
time point at which the psychological 
situation of an organism is asserted 
to be an event of a given class. For 
this purpose we shall superscript the 
event class symbol with a symbol 
giving the temporal designation. 
Thus an expression meaning, “If an 
organism is in the situation A and is 
making only responses of class B 
(ones which will not carry it out of the 
situation A) at time ¢t = 0, the prob- 
ability that it will be making a re- 
sponse also of the class B at a time 
infinitesimally later (¢ = dt), is equal 
to the value p”’ would be written: 


P(A.B,B*) = p. 


In such expressions we shall always 
omit the time designation 0, i.e., for 
B® we shall write simply B. 


First Assumption 


If a probability of response to a 
stimulus exists, the numerical value 
of the probability that the response 
will occur within a short interval of 
time is proportional to the size of the 
time interval. This proportionality 
is constant in time so long as the stimu- 
lus situation remains as initially de- 
fined,? and no approach to the dis- 


2The stimulus situation may be defined 
with various degrees of restriction. We may 
consider the situation defined so that it termi- 
nates only when the organism makes the final 
approach response to the discriminative stimu- 
lus. This is the approach taken here. We 
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criminative stimulus is emitted. In 
symbolic form this assumption is 
written: 


P(A.B,B*') = adt. 


This expression is to be read, “If A 
and B hold at some time ¢, then the 
probability that B holds at time ¢ + 
dt, is equal to adt, where a is a con- 
stant.” 

This assumption formulates the 
structure of the event sequence 
governed by the probability P(A,B) 
as an instance of a continuous prob- 
ability sequence, and as such, also as a 
sequence with probability transfer (2). 
The constant a@ is called the transfer 
coefficient of a continuous probability 
sequence and it measures the strength 
of the tendency of the sequence to 
switch from B to B. This type of 
organization is the probability model 
for causal chains. Essentially, then, 
this first assumption asserts that the 
states of an organism considered in 
temporal order constitute a causal 
chain. More precisely, we postulate 
that the probability of response at 
any instant depends only upon the 
state of the organism at the immedi- 
ately preceding instant, without ref- 
erence to how that state may have 
been brought about by events which, 
in turn, preceded it. 


Second Assumption 


The probability that no response 
occurs within the time interval f¢, 
where the interval ¢ is measured from 
a zero point at which the response of 
the organism is B, is a continuous and 
differentiable function of ¢. Since 


may, on the other hand, break this period up 


into parts. We consider a series of situations, 
each of which ends when the orientation of 
the animal changes from one aspect of the 
total stimulus situation to another. This is 
the VTE problem and it will be treated in a 
later paper. 
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this postulate requires a probability 
to be a function of time, we shall write 
the probability as f(t). The symbolic 
definition of f(t) is then 
f(t) =lim 
dt — OP(A.B,B*.B™4*,..-, Bn), 
ndt =t 


The meaning of the limit symbol, 


lim 
dt— 0, 
nat = t 


is that the time interval ¢ is divided 
up into more and more parts, each of 
which gets smaller and smaller but al- 
ways subject to the restriction that the 
sum of the parts, viz., ndt, is equal to 
the whole interval, ¢. This assumption 
is that the function, f(t) is continuous 
and differentiable in ¢. 


Third Assumption 


The sequence of response instants 
starts with a B. Symbolically, it is 
expressed f(0) = 1; in words, only 
sequences starting with B are con- 
sidered, and for such sequences and 
only for such sequences is it the case 
that the probability of B at the time 
t = 0 is equal to 1. 

This set of assumptions has a very 
broad generality. They have been 
taken as our starting point, in the pres- 
ent instance, in order to give a theory 
of the measures of discriminative be- 
havior, but they are equally applicable 
as a starting point for the theoretical 
consideration of any sort of behavior 
whatsoever. From the standpoint 
of the modern theory of causality they 
can be shown to be involved in any 
attempt to treat behavior as causally 
understandable. The first assump- 
tion merely lays down the principle 
that a behavior is causally determined 
by its immediate organic antecedents. 
The second assumption is needed pri- 
marily to expedite the mathematical 
treatment and its psychological con- 
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tent is unimportant. The third as- 
sumption concerns initial conditions 
in a way which is always satisfied in 
practice, that is, predictions of be- 
havior are made from a knowledge of 
the antecedent conditions of the be- 
havior. 

We now proceed with the results of 
deductions in the general theory 
which will give 1) an identification 
of a, the transfer coefficient, as an ex- 
ponential constant in a probability 
expression; 2) an explicit expression 
for the time course of the probability 
of response; 3) the distribution func- 
tion for latencies of response. We 
can derive* from the assumptions the 
following relation 

f(t) = e-**. (1) 
This result justifies the reference to 
a as the exponential constant, and 
gives the explicit expression for f(t). 

The meaning of (1) will be clearer 
if we consider it applied to the dis- 
tribution of response times of a group 
of animals having identical response 
tendencies and placed in identical 
test situations. For each animal the 
probability of response within any 
short time interval is the same as for 
every other animal, but as time goes 
on more and more animals have re- 
sponded and, hence, the number re- 
maining from which responses with 
longer latencies can come is reduced 
more and more. In short, the num- 
ber responding per unit time decreases 
exponentially. The structure is anal- 
ogous to the physical example of 
radioactive decay. The case of a 
single animal introduced repeatedly 
into the test situation is explained 
similarly, since the chance of a re- 
sponse occurring with any given 
latency is run through on a particular 
trial only if the given latency is 
shorter than the actual latency shown 
on the trial. Thus, the occurrence of 


3 See appendix: Derivation A. 
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a response stops the sequence. There 
is, then, no possibility of a longer 
latency on that trial. 

We shall use the symbol f(t) for the 
probability that a response occurs at 
least once in a time interval, ¢. For 
this probability function we obtain; 


f®) =1-—e*. (2) 


The distribution function for laten- 
cies will be given by the product of 
the right hand sides of (1) above and 
assumption 1, since a latency is a time 
interval during which the response 
status of the organism is continuously 
B, and which is terminated at the 
instant that B occurs.‘ Using g(t)dt 
for this distribution function, we find; 


g(t)dt = e-*tadt. (3) 


That this is a highly skewed distribu- 
tion function conforms to expectation 
from common observation of latencies. 
Subsequent to the development of 
the ideas in this paper an article by 
Mueller appeared which reports data 
giving strong support to the special 
form of distribution derived from our 
postulates (1). 


THEORY OF DISCRIMINATION 
LEARNING MEASURES 


We proceed, now, to apply the re- 
sults of the foregoing derivations to 
behavior in discrimination learning 
problems. As we stated earlier, the 
usual measure of learning of a dis- 
crimination is proportion of trials 
correct. This measure is a statistical 
estimate of a probability. We must 
deduce how such a behavior probabil- 
ity, e. g., Tolman’s behavior ratio, is 
related to the basic probability of 
response. 

4 The theory of the distribution of latencies 
in situations other than the simple one of 
single presentation of stimuli is more compli- 
cated. It will be developed in subsequent 


papers. 
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Let us employ C and W for, re- 
spectively, proportion of responses 
correct and proportion of responses 
wrong, and p and gq for, respectively, 
probability of response to rewarded 
(correct) and non-rewarded (wrong) 
stimuli. Let B, represent the correct 
response (response to the rewarded 
stimulus) and B, the wrong response 
(response to the non-rewarded stimu- 
lus). If B. = B,, that is, if what we 
call response By, is simply the failure 
to make response B,, then B,; and Bz 
exhaust the behavior possibilities of 
the situation. As a result, for this 
case we have, C = p, and W =4q. 
Because these relations hold, and be- 
cause it is always the case that, C + 
W = 1, we have p+q=1. This 
case is a degenerate one in which 
there is no difference in value between 
C and p, nor between W and gq. In 
psychological experimentation this 
structure corresponds to the situation 
on each trial in the classical condition- 
ing paradigm. We shall say that the 
organism has a “‘real’’ choice when, as 
in a typical discrimination problem 
trial, the organism has the possibility 
of responding to either of two stimuli 
or may fail to respond to either. The 
meanings of p and g are unchanged, 
but C and W are different. When 
“trial’’ is specified to include responses 
to either of two stimuli but to exclude 
cases of failure to respond, we mean 
by C, proportion of trials correct, the 
relative frequency of responses to the 
correct stimulus counted among trials 
so defined. The value C is then a 
statistical estimate of the probability 
that if the subject is in the test situ- 
ation and responds with either response 
B, or response B:, then the response 
made is B;. Symbolically, 


C= P(A[B, Vv B,},B). 


By the rules of the calculus of prob- 
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ability we obtain from this expression, 


oP P(A,B,.[ Bi v B, }) 
P(A, Bi Vv B,}) 
:. P(A,B:) 
~ P(A,B,) + P(A,B:) 





C= 





The probabilities in this expression 
are our basic probabilities of response, 
p and q, so, finally we have, 


p , 
C= and correspondingly, 
p+q 
q 


~p+@ 


The above relations are valid only 
when each trial provides merely the 
choice between responding to a single 
presented stimulus or failing to re- 
spond and also when there are two 
kinds of trials, viz., those in which the 
correct stimulus is presented and those 
in which the wrong stimulus is pre- 
sented. This is the experimental 
paradigm we call “single stimulus 
presentation.”” The alternative, and 
more common, way of presenting the 
stimuli, i.e., both stimuli presented 
on each trial, we call “paired stimulus 
presentation.” 

We must develop the theory for 
this usual case of simultaneous 
(paired) presentation. We shall re- 
strict ourselves to the case in which 
the processes of emission of approach 
responses to the two stimuli are inde- 
pendent. This is a significant re- 
striction. Because of it we cannot 
expect the theory developed here for 
paired stimulus presentation to apply 
when the choice point behavior is char- 
acterized by VTE. However, in many 
discrimination problems, particularly 
after the discrimination has been 
fairly well learned, VTE’s are infre- 
quent. In this case the’ probability 
structure is an instance of what is 
known as the competition of chances 
(2). In this arrangement the prob- 


W (4) 
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ability of each of two events is reduced 
from what the probability would be 
if the chances of the two exclusive 
events were not operating concur- 
rently. The reduction in probability 
is not produced by neural interaction. 
This possibility has been ruled out by 
our assumption of independence. It 
is, rather, purely and simply a con- 
sequence of the formal structure of 
the probabilities defined to describe 
the psychological situation. The ef- 
fect can be ascribed to the fact that 
the occurrence of one of the two 
events cuts off part of the time interval 
during which the other event might 
otherwise have occurred. Through 
the use of the probability calculus we 
can derive the proper values for r, 
the probability of response to the 
positive (rewarded) stimulus reduced 
by the competition of chances, and of 
s, the corresponding probability of 
response to the negative (non-re- 
warded) stimulus. 

The probability value, r, which we 
need is the probability that a response 
is made to the correct stimulus before 
it is made to the wrong stimulus. 
The following expression can be de- 
rived.5 

B 


gee — g~(B+y7)t 
r ca (1 e ). (5) 


Similarly for the probability, s, 


oe 
B+y¥ 


With these values determined, we 
may now calculate the proportion 
correct responses for the paired pres- 
entation case. 


s (1—eFm). (6) 


RS 
r+s Bt+yY 


The tools are now at hand to demon- 
strate how an uncritical use of the 





C= (7) 


5 See appendix: Derivation B. 
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measure, proportion of trials correct, 
can result in erroneous interpretations 
of learning phenomena. Let us con- 
sider the following experimental de- 
sign. Two groups of animals are 
trained to discriminate the same two 
stimuli. One is trained by the usual 
paired presentation method, the other, 
by single successive presentations of 
the stimuli. The attempt is made to 
equate the level of learning in the two 
groups in terms of proportion of trials 
correct. Then the method of train- 
ing is switched between the two 
groups and proportion of trials cor- 
rect is again measured. We shall 
need identifying subscripts for the 
quantities appearing in our expres- 
sions. A preceding subscript will 


refer to the method of running the 
training trials, a following subscript, 
to the method of running test trials. 
Thus, ,C; means the proportion of 
trials correct for a group having train- 
ing under procedure 7, measured while 


running under procedure j7. We shall 
use ‘'2”’ for “paired” and “1” for “‘sin- 
gle,’’ as subscripts. With symbols 
so defined we derive® the three in- 
equalities: 1C; > 2Ci, 1C2 > 2C2 and 
1C2 > 2C;. Paraphrasing this result 
in verbal form, we have: If two groups 
are trained on a discrimination prob- 
lem to the same criterion score in 
terms of proportion of trials correct, 
one:group by paired presentation and 
the other group by single presentation, 
the amount learned by the single pres- 
entation training group will be greater 
than the amount learned by the paired 
presentation training group. This is 
the case regardless of which method is 
used to test amount learned provided 
only that both groups are tested by 
the same method (:C; > 2Ci and 
1C2 > 2C2). Furthermore, if the run- 
ning procedures are interchanged, the 
group¥changed from paired to single 


6 See appendix: Derivation C. 
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presentation will make more errors 
than the group changed from single 
to paired presentation (;:C2 > 2C;).? 
Finally, this predicted outcome of the 
experiment does not result from a 
difference in amount learned ascrib- 
able to the difference in training 
procedure. The reason for the pre- 
diction lies in the difference in the 
meaning of the measure, proportion of 
trials correct, when it is applied under 
the conditions of the two different train- 
ing methods. 

There is some reason to believe that 
a difference in learning rate between 
the two training procedures exists. 
If such a difference does exist, it can 
be shown only by testing against a 
null hypothesis which takes account 
of the results developed here. That 
is to say, the appropriate null hy- 
pothesis does not specify a zero differ- 
ence in the proportion of trials correct 
after a fixed number of trials unless 
the measurement is taken under the 
same running procedure for each 
group. 

It should be noted that the predic- 
tions derived above follow from the 
very simple assumptions from which 
we started. The only additional prin- 
ciple needed is a minimal character- 
istic of the learning process in a 
discrimination problem, that is, that 
the response probability to the posi- 
tive stimulus increases, or the response 
probability to the negative stimulus 
decreases, or both. We have not 
required a specification of numerical 
values or of the analytic form of the 
learning function. 

The conclusions reached demon- 
strate that proportion of trials correct, 
taken in itself, does not constitute a 
proper measure of amount learned, 
because its meaning changes with the 


7 This prediction will be shown to be con- 
firmed by experimental data in a subsequent 
paper. 
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situation to which it is applied. 
Furthermore, probability of response 
is unsatisfactory since, being a func- 
tion of time, it does not have a fixed 
value. However, probability of re- 
sponse as a function of time depends 
on the exponential decay constant, 
and this value does have a standard 
meaning independent of the arrange- 
ment of stimuli by trials. If the ex- 
perimental situation in the single 
stimulus case were so structured that 
immediately following each response 
the animal were to return to the initial 
situation the exponential constant 
would be identified with rate of re- 
sponse. A similar but more complex 
relation can be derived for the paired 
presentation case. The proposal to 
use the exponential constant as a 
measure is therefore not unprece- 
dented since Skinner (3) has proposed 
rate of responding as a measure and 
has used it extensively. Skinner's 
justification for the measure is almost 
wholly heuristic. What has been 
contributed by the present paper is a 
theoretical analysis of the measure 
and a demonstration of its wide range 
of applicability. 


SUMMARY 


Starting from simple assumptions 
concerning the relation of the state of 
an organism to its probability of re- 
sponse, deductions have been made 
using the calculus of probability and 





f(t) = lim 


di — OP(A.B, Bt. B+. . - 


ndt = t 
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applied to an analysis of the measures 
of behavior used in discrimination 
learning problems. The results dem- 
onstrate that the meaning of the 
measure, proportion correct trials, is 
dependent upon the type of experi- 
mental situation to which it is applied. 
The transfer coefficient of a continu- 
ous probability sequency is shown to 
be an appropriate measure of strength 
of response tendency. 


APPENDIX 


Derivation A. 


Assumption 1 states; 


P(A.B,B#') = adt. (1) 


From (1) we derive; 
P(A.B,B*) = 1 — ade. (2) 


From assumptions 1 and 2, specializing 
for t = dt, we have, 


P(A.B,B*) = f(0 + dt). (3) 


Expanding the right side of (3) in a 
Taylor series and dropping second and 
higher order differentials, since we shall 
go to the limit, dt = 0, 


P(A.B,B*) = f(0) + f'(O)dt (4) 


Since, by assumption 3, f(0) = 1, com- 
parison of (2) and (4) leads to the 
conclusion 


a =— f'(0). (5) 


This result identifies the exponential 
constant, a, with the initial slope of f(t). 
By definition, and as justified by assump- 
tion 2, we have; 


~ ne. (6) 


The right hand side of (6) can be factored into the terms, P(A.B,B*), P(A.B?t, 
B**), P(A. B**, B*4*), etc., since by the definition of probability transfer, the probabil- 
ity at any instant is dependent upon only the state at the immediately preceding 


instant. 


Furthermore, since B specifies the same state regardless of the time super- 


8 The relations among probability of response, behavior rate, the transfer coefficient and 
latency in the Skinner box involve interesting problems beyond the scope of the present paper. 
The theory of measures in the Skinner box will be presented in a further paper. 





MEASUREMENT OF DISCRIMINATIVE BEHAVIOR 451 


script, each of the factors has the same value as every other. Hence, the probability 

expression after the limit sign in (6), substituting for each factors the value given by 
at —1 

(2), becomes: (1 — adt)". If we let adit = ee we have also n = — mat. 


Making this substitution, and noting that as dt approaches zero, m goes to infinity, 


we transform (6) into; 
mi-—at 
fo = tii (1 = +) ° 
m—@ m , 


The expression inside the large brackets is the definition of the transcendental 
number e, therefore we have, 


f(t) = a. 
Derivation B. 


The probability value, r, which we need is the probability that a response is made 
to the correct stimulus before it is made to the wrong stimulus. Because of the trans- 
fer character of the probability sequence and assuming the two response emission 
processes independent we have, 

P(A.B,4*.B,%!,. - - By -D4t, Bytt, Bet... By(m-Ddt Bindt) = Bdt, 
P(A.B,*'.B 4. ‘ - By “I)dt Bett, Bt. e - By(n—dt Banat) = ydt. (8) 


Where B and ¥ are, respectively, the transfer coefficients for probability of response 
to the positive stimulus and the negative stimulus presented singly. The probabil- 
ity that both responses are emitted in the same time interval, dt, is Bydt#. Thisisa 
second order differential and may be neglected. The case that the correct response 
is emitted in one of the intervals, dt;, dte,---dt, may be written, 

By v Bt Yrer Bynat = By v B,**.B,#*.B 2% vies vw Bitte... 

B,("-D4t_ Bat... » Bynat_B nat (9) 
Since the terms on the right in (9) are exclusive, the corresponding probabilities 
may be added, therefore, 
r = P(A,B,4* v By v--- v By) 

= P(A,B,*) + P(A,By*'.By.By**) +--- 

+ P(A,B,**.B,*!- ‘ - B,-ddt_ Bodt Bet. - » By(n-Ddt Bnd) | (10) 


Each of the terms on the right in (10) can be factored. Using relations (8) we 
obtain, 


r = Bdt + (1 — Bdt)(1 — ydt)Bdt +---+ (1 — Bdt)""(1 — ydt)""Bdt 

(1 — Bdt)"(1 — ydt)" — 1 

(1 — Bdt) (1 — ydt) —1 

Pye: Fe 
B+ ¥ — Bydt 





= Bdt 


[1 — (1 — Bdt)"(1 — ydt)"]. (11) 


The term B ydt goes to zero as dt goes to zero and can hence be dropped. Putting 


t 
dt = — we have, 
n 


(1 — dt)" = (1 af )’ 
n 
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Using the definition of the transcenden- 
tal number e, as before, 


Feel (1 = *\ = 


Therefore (11) becomes 


r = —— (1 — e 4+), 


~ B+Y 


Similarly for the probability, s 


¥ 
——— (1 — e~S+n1), 
~B+Y 


Derivation C. 
From relation (2),® substituting ‘p’ for 
f(t) and solving for a, we find: 


— ] 
a= or us log(1 — p). 


Taking into account (4),° (5),9 and 
(7), we arrive at the four relations 
descriptive of the situation of our hy- 
pothetical experimental design: 


Pr 
7 oe, 14) 
6 ta ( 
_ log 1 ~ Pi) 


—s (15) 


: log(1 — pi y+ log( a q)’ 
log( (1 — p2) 


log(1 — po) + log(1 — q:)’ 


Pr os 
—f 1 
be + q: (17) 


The relation, p > g, will hold at the 
time of switching if discrimination learn- 
ing is any process which increases the 
probability of response to the positive 
stimulus or decreases the probability of 


®These relations are from main body of 
article. 
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response to the negative stimulus, or 
both. It is readily seen that if p > q, 
then 


ti — p)| 
llog(1 — p)| (18) 


* |log( - MI 
q 


The limits on the values of p and q are 
0 and 1, hence, both logarithms have 
negative signs. Noting this, we can 
modify (18) to the form; 


. = 
p+q 
log(1 — p) 


. 9 
“fi-p + log(1 — q) -" 





Because of inequality (19) we _ infer 


that at the time of switching; 


1C2>1C, and 2C2> 2C;. (20) 


But, by the conditions imposed by the 
experimental design, at this time; 


2C2 =,1C). 
Therefore we conclude; 
iC; > 2C1, 


1C2 > 2C2 
iCe > oC}. 
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THE BRAIN ANALOGY: A DISCUSSION * 


BY H. EDGAR COBURN 
Registered Civil Engineer, San Diego, California 


INTRODUCTION 


The Brain Analogy theory of behav- 
ior, presenting a point of view that dif- 
fers in detail from some existing schools 
of thought, invites a re-appraisal of our 
concepts. The following discussion sup- 
plements the original paper (1). 


NATURE OF THE BRAIN ANALOGY 


The Brain Analogy (BA) is one of 
several particular cases of the same gen- 
eral mechanism or concept. The signif- 
icance of the relationship is that it seems 
to cast light on the nature and origin of 
intelligence. The general case, the Cor- 
relation Detector (CD), to give it a 
name, would be similar to the BA except 
for its symmetrical latency distribution 
and consequent indifference to the direc- 
tion of conditioning. 

The universe is rational, a funda- 
mental premise of science, and therefore 
there is a fixed percentage of the S in 
any situation that are related to the US. 

The S is always compound for com- 
plex animals, but initially this fact is of 
no significance to the nervous system be- 
cause various types of neurons are col- 
lected into functional clusters (an inhib- 
itory bipolar, for example, is function- 
ally a mono-polar when the inhibitory 
pole is stimulated at a sub-threshold 
level). The components of the com- 
pound §S act as one simple S of equiv- 
alent intensity, even though each com- 
ponent appropriates a share of the motor 
cells; however, this latter fact remains 
concealed from both the organism and 
experimenter as long as the program is 
unchanged—test trials omitted. For the 


1 The author wishes to express his gratitude 
to Vera Jane Coburn for her assistance in pre- 
paring the manuscript. 
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purpose of analysis, then, we can as- 
sume the existence of elementary S. 

Since the brain has no way of “know- 
ing” which §S are significant, it must 
necessarily sample the sensory universe 
and condition to all S on a probability 
basis. There is no @ priori criterion for 
assigning probabilities, but these are de- 
termined by the nature of the environ- 
ment, the nature of the organism, and 
the interaction of mutations and natural 
selection. Experimental observation in- 
dicates that magnitude and recency of S 
are of primary importance. 

The simplest hypothesis concerning 
two elementary stimuli, CS and US, is 
that they are either related or random. 

The unknown probability that the S 
are related is p, and that they are ran- 
dom is g=1-—p. The probability of 
obtaining x related pairs in m sensory 
samples (or x stable, conditioned delta 
cells on m motor cells) is given by 


n! 


P(x) = "qr, 


x!(n — x)! 


which increases with a relative increase 
in CS over random S. This binomial 
distribution for discrete variables, ap- 
proaches as a limit normal distribution 
with mean np and SD = Vnpq as the 
number of samples increases (2, Chapter 
3). The mean of the samples equals 
the “fixed percentage in a rational uni- 
verse” and therefore the conditioning to 
any component will be approximately 
proportional to its relative strength as 
defined in terms of the relative number 
of delta cells involved. Since this is a 
fact that motor cells are appropriated by 
S components in proportion to their rela- 
tive strengths (5, p. 142), we can infer 
that the probability of significance of S 
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is proportional to their relative magni- 
tudes; differences between analyzers and 
between species are adjusted by muta- 
tions and natural selection which alter 
the relative number of delta cells. 

The sampling, of course, is done only 
by the actuated and accessible motor 
cells. The stable, appropriated cells are 
not of sample distribution, except mo- 
mentarily, because all but systematic 
connections are driven to extinction be- 
tween formal trials and the remainder 
are therefore biased. After repeated 
trials, when the animal “knows” the cor- 
rect signal, it nevertheless continues the 
process of random sampling by means of 
the accessible motor cells. If it were not 


thus, if “knowing” prevented further 
sampling, the organism would be at a 
serious disadvantage in all cases where 
its hypothesis was erroneous. Up to this 


acs 


iIn- 


point we have considered only an 











stantaneous” sample, mostly ignoring 
the fact that S are also temporally dis- 
tributed. 

Curve CD (Fig. 1) implies that the 
probability of a relationship between two 
S is greatest when the S are closely re- 
lated in time. But this is the general 
case, the CD, and is not a satisfactory 
hypothesis for an animal to react to be- 
cause it fails to indicate which S comes 
first. A better hypothesis is curve CE, 
a qualitative distribution function repre- 
senting cause and effect, which implies 
a particular temporal sequence—the CS 
followed by the US. For an abstract 
study of cause and effect, the CE curve 
may be satisfactory, but again we fail 
to establish a hypothesis suitable for 
animals because inertia has been ignored. 
It is at this point that the BA-type hy- 
pothesis enters the scene with provision 
for both temporal sequence and inertia: 


L-0.8 m. 

1 
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Fic. 1. The probability of relationship between CS and US is shown for each of three dis- 
tributions. The area under each curve is unity (with logarithmic abscissas for BA). BA is the 
result of biologic evolution as explained in the text. 
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ORIGIN OF SKEWED LATENCY 


Biological data suggest that organ- 
isms, and their nervous systems, vary 
due to unknown factors that influence 
the germ cells and that these hereditary 
variations or mutations, which appar- 
ently may be directed in more or less 
random é€volutionary directions, are sub- 
ject to an elimination process in the 
struggle for existence. Asa consequence, 
nervous systems reflect the nature of the 
environment, and should therefore be in 
agreement with the CD-type hypothesis 
or one of the particular cases. The ex- 
istence of inertia makes it impossible for 
an animal to respond correctly to signals 
which are too closely followed by the 
US; the failure is an obstacle to survival 
—the “correct” cerebral connection is 
futile. Therefore, the mutations which 
tend toward the general theoretical case, 
the CD, or even the CE, are eliminated 
in favor of the mutations which not only 
involve more latency for CS pulses than 
for US, but also delay CS pulses a min- 
imum amount (1, Postulate 5) which 
should be roughly in proportion to the 
mass of the animal. 

It is also worth noting that the BA 
complies with other evolutionary re- 
quirements to the extent of being a 
structure that can evolve by successive, 
but more or less imperceptible, steps or 
mutations each one of which is func- 
tional. In addition, it possesses the 
property of allowing extirpation of parts 
without rendering the entire mechanism 
inoperative. In fact, if the parts are 
located spatially in accordance with func- 
tion, as appears to be true of organic 
nervous systems, comparable extirpations 
will have comparable results, and in gen- 
eral, the degree of loss in complexity of 
function will parallel the loss in parts. 
These considerations, important for 
learning theory, and vital in the selec- 
tion of an adequate postulational sys- 
tem, will be made more evident in a 
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proposed future paper on subcortical 
mechanisms. 


VERBALIZATION 


Intelligence has been defined as the 
property of reacting on a basis of prob- 
ability as determined by the individual 
organism’s incomplete sensory samples 
of the environment (1, p. 155). 

No mechanism, organic or otherwise, 
has unlimited sensory possibilities. The 
limitations restrict the number of pos- 
sible correlations that can be formed di- 
rectly through the senses and without 
intervening variables. They restrict in- 
telligence. 

Although man has zero intelligence 
where X-rays are concerned (because he 
has no X-ray receptors), he can use in- 
struments and verbalization to effect ap- 
propriate responses. But he is then 
showing intelligence for “pointer read- 
ings,” say, and not for X-rays per se. 

The introduction of intervening vari- 
ables, instrument readings, printed data, 
etc., coupled with some form of verbal- 
ization process, increases the effective 
use of existing intelligence. However, 
an approach based on verbalization is 
unnecessarily redundant. In communi- 
cation theory, too, verbalization has been 
found to be exceptionally inefficient; in 
fact, Shannon (8) and others have 
shown that verbal English occupies ap- 
proximately 1000 times the frequency 
spectrum required to transmit the ac- 
tual information involved. 

The only excuse for the existence of 
verbalization is that we do not possess 
the appropriate receptors to make direct 
correlations. Fortunately, inorganic in- 
telligence can avoid the handicap and 
for this reason, as well as for others, it 
can be much simpler for a given per- 
formance. 


THE MEASURE OF INTELLIGENCE 


The fact that all mammals are roughly 
equal in maze-learning ability (4, p. 
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109) seems to show that the condition- 
ing mechanism itself is approximately 
the same and that there is an optimum 
rate of learning. The differences in in- 
telligence, then, may be due essentially 
to the differences in analyzers. We re- 
fer, of course, not to the receptors them- 
selves, but to the entire mechanism be- 
tween S and delta cells. 

Supporting evidence for the hypothe- 
sis is found in musical aptitude studies. 
Highly intelligent behavior, where pitch 
discrimination is concerned, is impossi- 
ble if the auditory analyzer is below 
average. Nor will any amount of prac- 
tice correct the difficulty (7, p. 58). 

If differences in intelligence are due 
primarily to analyzer differences, as sug- 
gested by the above data, it is clear that 
the measure of intelligence is the ability 
to discriminate. Where an objective test 
is available, as with pitch discrimination, 
measurement is relatively simple. Where 
objective standards are difficult to estab- 
lish, as with verbal discriminations, the 
results may be less satisfactory. With 
animals, other than man, a habit-satura- 
tian technique can be employed, but 
care must be used in the selection of a 
measure of the strength of the habit. 
The BA theory indicates that magnitude 
of response and resistance to extinction 
are inadequate. The true measure of 
habit strength is the percentage of motor 
cells, actuated during learning, appro- 
priated by stable connections. Not only 
is there no means as yet of making this 
measurement, but the size of the stable 
group will fluctuate with changes in the 
experimental program. Furthermore, a 
complete appraisal of intelligence re- 
quires tests of all analyzers. 


OpTimuM LEARNING RATE 


It is probable that the interaction of 
various mutations and natural selection 
has established a rate of conditioning 
which closely approximates the theoret- 
ical optimum. While slow learning is 
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obviously detrimental, extremely fast 
learning may likewise be injurious when 
we recall that one or two sensory sam- 
ples do not determine an answer but 
merely establish a hypothesis. The 
brain has no way of “knowing” which 
elements of the stimulus situation are 
significant. It must necessarily accept 
and condition to all S, automatically, 
and in accordance with probability. The 
appearance of purpose is due solely to 
the fact that systematic S result in 
stable conditioning. This is exactly 
analogous to the fact that organisms, in 
general, appear to be purposive due to 
extermination of “non-purposive” muta- 
tions in the struggle for existence. A 
sample of stable habits, like a sample of 
living species, is grossly biased. 

Let us start by assuming that condi- 
tioning is complete in one trial. Al- 
though nearly all actuated motor cells 
are appropriated within approximately 
0.3 second, roughly 90 per cent of the 
CS elements are random or at least un- 
stable, and 10 per cent represent the 
conventional CS. The same random 
elements, of course, are not necessarily 
actuated each trial, some are actuated 
between trials with consequent extinc- 
tion, and the stable elements gradually 
assume complete control. 

Mutations and selection would in- 
crease the conditioning rate for the con- 
ventional CS only if there were no dis- 
advantage in a faster rate. The fastest 
possible satisfactory rate is that which 
still maintains the elements of the sen- 
sory environment in the proportion of 
their probable significance, which is 
measured by amplitude, recency, etc. 
The proportional distribution of the 
stimuli insures that minority signal ele- 
ments are not unduly discriminated 
against and hence the increment of the 
conventional CS is approximately 10 per 
cent (less for minority elements) ; other- 
wise, we have a deviation from the defi- 
nition of intelligence. 
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The conventional CS is shown as a relatively small part of the total CS in conformity 
with the fact that conditioning is on a probability basis. 


While the conventional CS is entirely 


arbitrary, the brain, making no such distinction, automatically accepts all stimuli and conditions 


to them in proportion to their relative magnitudes at the delta cells. 


The total-conditioning 


curve (on a separate vertical scale) flattens off at 100 per ceni appropriation of motor cells 


within approximately 0.3 second after beginning of US. 


In this figure US is timed to start at 


the end of minimum delta cell latency and the overt conventional CS is an auditory “click.” 


The effective duration is now seen to 
be the temporal distribution of condi- 
tioning of a population of delta cells, 
rather than an independent postulate, 
and it is unnecessary for the motor cell 
to disable itself (1, Postulate 13). Con- 
tinuing in a qualitative vein concerning 
the nature of the temporal distribution 
function, and assuming SD = 0.075 sec- 
ond, enough motor cells are still avail- 
able for a longer time than minimum 
sensory cell latency (of the conventional 
CS) to permit a small percentage of 
backward conditioning. This is transi- 
tory (5, p. 393), except for interference 
by gamma phase differentiation,’ be- 
cause of displacement by less latent ele- 
ments of random S. The possible back- 
ward conditioning occurs, of course, 


2Formerly called periodic reconditioning 


(1, p. 162). 


only when the experimental program is 
appropriate. 

It is evident that isolated action of a 
conventional CS is without foundation in 
fact. The actuated motor group is al- 
ways quickly appropriated by delta cells 
because zero sensory stimulation is non- 
existent and weak stimulation is largely 
offset by strong Q (1, Postulate 12). 
The conventional CS is merely part of 
the ever-present, relatively large, sen- 
sory universe (see Fig. 2). 


REINFORCEMENT 


The original BA paper specified that 
reinforcement of conditioned and uncon- 
ditioned deita cells are separate phe- 
nomena (1, p. 161). The mechanism 
of reinforcement for unconditioned delta 
cells is unsatisfactory for reinforcement 
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of conditioned cells because the former, 
having a probability basis, would cause 
instability of S differentiation if applied 
to the latter. This fact was discovered 
too late to be dignified as a formal pos- 
tulate. And no explanatory mechanism 
is being offered here, except to observe 
the implication that some additional fac- 
tor is involved. Along this same line it 
should be noted that conditioning of a 
delta cell by another delta cell pulse, in 
the motor cell body, is expressly for- 
bidden by the presence of the disabling 
function. Current research by the au- 
thor supports the belief that secondary 
conditioning (5, p. 33) does not involve 
such delta cell-to-delta cell conditioning. 

The basic cause of lack of agreement 
between various schools of thought on 
the nature of reinforcement, stems from 
the fact that instrumental conditioning 
and allied phenomena are inherently 
much more complex than the idealized 
salivary reflex. It is equally impossible 


to give convincing support to the BA 
concept of reinforcement, which em- 
braces both classical and instrumental 
conditioning, without employing prop- 


erties of subcortical mechanisms. It is 
easier, but far from satisfying, to show 
that some of the accepted views on re- 
inforcement are seriously compromised 
by available evidence. 

Food reinforcement for the condi- 
tioned salivary reflex may be quite dif- 
ferent from feeding at the end of a maze. 
The latter, usually considered to be re- 
inforcement, in spite of latent learning 
experiments, terminates the drive (at 
least temporarily) and thereby causes a 
selective action to take place. The pos- 
sible UR’s are elicited during drive by 
the various random US (reinforcement) 
in the presence of the CS (1, p. 177). 
The ofder.being somewhat random, due 
partly to fluctuating thresholds, indicates 
that the CR’s which form will not all 
receive reinforcement each trial. The 
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exception, of course, is the “correct” re- 
sponse because each trial continues until 
it is elicited. The correct habit, never 
receiving non-reinforced trials, ascends 
to the head of the hierarchy; the other 
CR’s lead a fluctuating existence but do 
not necessarily become completely ex- 
tinct. The termination of drive, after 
the correct CR, assures that all other 
CR’s will be insecure. Failure to ter- 
minate the drive would allow the effect 
of the CS to continue, after reinforce- 
ment by the appropriate random US, 
with resulting decrement following de- 
pletion of the gamma phase. In other 
words, Aabits continually form and de- 
cline during drive, but if a systematic 
drive-termination procedure is followed, 
the habit formation becomes selective. 
This gives the appearance of reinforce- 
ment by feeding, say, but this ‘need re- 
duction” is not only incidental as far as 
conditioning is concerned, it actually fol- 
lows conditioning. The advantage of 
this hypothesis is that it applies equally 
well to glandular reflexes being of the 
S-R type. 

Another example concerns the avoid- 
ance of shock. It has been said that the 
avoidance of shock—the absence of stim- 
ulation—is reinforcement, yet it has been 
shown that the animal learns even though 
shock is never avoided (3, p. 7). 

Some of the difficulties concerning the 
nature of reinforcement disappear if we 
drop verbalization, which conceals in- 
consistencies, and substitute physical 
structures which expose them. It isn’t 
easy to look at a physical nervous sys- 
tem, biologic or analogic, even on paper, 
and imagine that absence and presence 
of stimulation are identical. In a phys- 
ical structure the concept of reinforce- 
ment has to be “pinned down.” The 
BA probably contains as many incon- 
sistencies as some other systems but part 
of its strength lies in the fact that they 
are visible rather than concealed. 
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Morar vs. MOLECULAR THEORIES 


The failure of “physiological” learn- 
ing theories to give explicit answers to 
numerous problems has, in the past dec- 
ade, given rise to suggestions to abandon 
the molecular approach. Reliance is to 
be placed on molar theories, ignoring 
the actual mechanism involved, and sub- 
stituting more or less abstract constructs. 
It has been said that, after all, the psy- 
chologist is concerned with behavior, 
and molar constructs offer a practical 
way out of the difficulties of neurological 
explanations. No doubt, the escape 
clause is attractive, provided the under- 
lying assumption is valid. 

The author worked along molar lines 
by using hypothetical nerves rather than 
neurons until the discovery of the prin- 
ciple involved in S differentiation—ex- 
clusive appropriation of motor cells by 
means of the disabling function (1, 
Postulate 13)—led to a consideration of 
the required mechanism. 

It is apparent, of course, that nerve 
properties are statistical properties of 
groups of neurons; it is not clearly evi- 
dent, however, that nerve properties pos- 
sess serious limitations for learning the- 
ory. Stimulus differentiation, for ex- 
ample, can be accounted for by nerve 
properties, provided no change is made 
during the experimental program, but 
the restriction can be removed only by 
assigning the explanation to neurons be- 
cause altering the program, in effect, 
calls for splitting the nerves into new 
stable and unstable groups (1, p. 169), 
thereby destroying their identities from 
a molar point of view. A major re- 
striction, operating at such a primitive 
level as S differentiation, is unlikely to 
be tolerated for long in psychological 
theory. 

The alternate is to dig deeper into the 
mechanism, even though the complexities 
appear to be multiplied, and consider the 
elementary properties of neurons; not 
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only will these elementary properties 
provide answers to many phenomena 
which would require unnecessary elabor- 
ations at the molar level, but being ele- 
mentary, are better able to survive the 
important test of interchangeable con- 
stants. In particular, it then becomes 
feasible to base theory on a physically- 
realizable structure and to comply with 
the dictum of physics that all constructs 
must be definable and detectable by 
means of experiments that are at least 
conceptually possible (6, p. 78). 


CONCLUSION 


The foregoing discussion must neces- 
sarily be considered heuristic, and, as 
always with science, provisional. It 
seems reasonable to conclude, however, 
that the importance of evolution for be- 
havior theory has been demonstrated. 
The author would also like to believe 
thatthe nature of reinforcement, prob- 
ably the outstanding problem in psy- 
chological theory, has been clarified a 
little. 

While the implied “normal” distribu- 
tion of the significance of the elements 
of the sensory universe is clearly of in- 
tuitive origin, and the top-heavy pre- 
dominance of “random” conditioning, an 
apparently necessary corollary, seems 
extreme, it is offered because the most 
acceptable measure of the value of a 
hypothesis is usefulness: It seems to 
work. 
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A “COMMUNICATION ANALYSIS” OF 
CONCEPT LEARNING 


BY CARL I. HOVLAND 
Yale University 1 


In concept-formation experiments the 
items presented in the learning series 
may be of two different types: “positive 
instances,” which are examples of the 
concept and include the essential char- 
acteristics, or “negative instances,” which 
lack one or more of the necessary char- 
acteristics, and are therefore examples of 
what the concept “is not.” The con- 
tribution of each type of item to the 
learning of concepts has been extensively 
studied by Smoke (5, 6). He found 
that negative instances are of little aid 
in learning the correct concept. What is 
not clear from his study and from similar 
investigations, however, is whether the 
ineffectiveness of negative instances is 
primarily attributable to their low value 
as carriers of information, or whether it 
is primarily due to the difficulty of as- 
similating the information which they 
do convey. 

The foregoing statement of the alter- 
natives indicates that the concept-forma- 
tion experiment may be regarded as a 
communication situation in which E 
transmits the combination of elements 
he has selected as constituting the con- 
cept through a series of messages, some 
of which are labelled “correct” (posi- 
tive instances) and others “incorrect” 
(negative instances). This formulation 
stresses the importance of first analyzing 


1 The writer wishes to express his apprecia- 
tion to Walter Weiss, for suggestions made 
during discussions preparatory to experimental 
work, and for assistance in determining em- 
pirically some of the information presented in 
Table 1, George A. Miller for helpful sugges- 
tions and criticisms, particularly concerning 
notation, B. J. Underwood for careful reading 
of the manuscript, and Shizuo Kakutani for 
advice concerning one of the formulae. 


the information transmitted by positive 
and negative instances, and then study- 
ing experimentally the relative difficulty 
of assimilating material presented via 
positive as compared with negative in- 
stances, equated with respect to the 
amount of information conveyed. The 
present paper is devoted to the first task, 
of analyzing from a theoretical stand- 
point the amount of information re- 
quired to specify a concept by positive 
or by negative instances. 

The difficulty with the usual concept- 
formation set-up for the present problem 
is its unclear structure. In the tradi- 
tional concept-formation experiment, a 
whole series of stimulus figures contain- 
ing combinations of characteristics con- 
stituting the concepts are presented to 
S together with paired names or non- 
sense syllables. Ss are required to give 
associated names at the sight of the ap- 
propriate stimulus figures. In Smoke’s 
experiment, for example, the syllable 
“dax” was to be associated with the con- 
cept of a circle with one dot inside and 
one dot outside. Variations were em- 
ployed from instance to instance in the 
size and color of circle and the exact 
position of the dots. Each positive in- 
stance was marked with a plus sign to 
indicate that it was an example of the 
class in question. Negative instances 
were introduced with a minus sign to 
indicate that they did not conform to 
the definition of the concept. 

What is quite unclear from such a 
method is S’s expectations as to the type 
of concept model to be employed and as 
to the number of characteristics of the 
stimulus figure which might be relevant 
to the concept-formation task. Without 


461 











462 


some common understanding on the part 
of E and S, it is difficult to define what 
information is conveyed by each in- 
stance. Otherwise, factors not intended 
by E to be relevant may be selected as 
possibilities by S, and the information 
conveyed may thus not properly elimi- 
nate some of these. Ss who are most 
imaginative in considering different pos- 
sibilities may be penalized. To take an 
extreme example, let us imagine an S 
who considers the color of the card on 
which the stimulus figures are being pre- 
sented to be a possible dimension to con- 
sider. He may on the basis of positive 
instances derive the concept that a “dax” 
is a circle with one dot inside and one 
dot outside on a white background. 
The extra dimension would be consid- 
ered incorrect by E, but it would be 
logically correct on the basis of the data 
presented to S. There is a suggestion 


in Smoke’s account that a result like this 


sometimes occurs. He points out that 
Ss are frequently able to distinguish be- 
tween correct and incorrect instances in 
the test series (prepared in terms of E’s 
definition of relevant factors), but are 
unable to define the concept correctly. 
Their definitions are customarily de- 
scribed as being “too general.” This 
might sometimes be due to S’s inclusion 
of characteristics which had been con- 
sidered irrelevant by E and hence not 
systematically eliminated as hypotheses 
by the series of instances used. 

There are, of course, many situations 
like Smoke’s, where the concept-forma- 
tion task is to determine the structure 
of the concept and ascertain which char- 
acteristics are relevant in an instructured 
and undefined situation. But because 
of the difficulties just mentioned, for the 
analysis of the present problem it will be 
clearer if we confine our attention to the 
type of concept-learning paradigm used 
by Oseas and Underwood (3). Ss were 
presented with Weigl-type stimulus fig- 
ures picturing squares, circles or tri- 
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angles. Each figure could be one of 
three sizes (14 inch, 1% inch, or 34 inch) 
and one of three shades (black, gray, or 
white). The concept to be learned con- 
sisted of a combination of one value of 
one dimension (e.g., the small (14 inch) 
value of the size dimension) with one 
value of another dimension (e.g., the 
circle from the shape category). This 
would give, as an example, a small circle 
as the concept. For any single concept 
the third factor was irrelevant (in this 
example, shade). 

In the Oseas and Underwood study Ss 
learned a whole series of different con- 
cepts and to each they associated an ap- 
propriate consonant letter. The role of 
positive and negative instances will be 
clearer if we restrict the analysis to the 
learning of a single concept. Let us also 
simplify the set-up further by consider- 
ing first a task in which there are three 
dimensions involved (form, size and 
shade as above) but where each dimen- 
sion has only two possible values (circle 
or square, large or small, black or 
white). S will be given complete knowl- 
edge of the set-up, i.e., he will know that 
these are the characteristics which will 
be used and that the correct concept will 
be a combination of one value on each 
of two dimensions |e.g., a white square 
(of any size) or a large black object 
(of any shape)]. S’s task thus consists 
of ascertaining which are the relevant 
dimensions and what values on each di- 
mension are correct. 

This type of model is schematized in 
Fig. 1. Each block represents an in- 
stance. The three characteristics of size, 
shade, and shape, will be referred to as 
dimensions and the different degrees of 
each characteristic as values on the di- 
mension. In this figure there are eight 
possible instances. (Dimension A with 
2 values X Dimension B with 2 values 
x Dimension C with 2 values.) 

Let us first consider the most gen- 
eral case. If no information at all were 
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with two values of each. 


given to S as to the nature of the con- 
cept, the dimensions involved, or the 
number of instances which are included, 
etc. he would have to consider 256 pos- 
sibilities (“hypotheses”) as to the com- 
binations involved. These would in- 
clude the one extreme case where all in- 
stances were to be included (where the 
concept was, for example, “geometrical 
figures”) and the other where none be- 
longed (e.g., “diamond shaped objects’’). 
There could then be various definitions 
which would include single instances (8 
possibilities), pairs (28), triplets (56), 
quadruplets (70), quintuplets (56), sex- 
tuplets (28), and septuplets (8). There 
are the familiar values of the binomial 
expansion and the total number of pos- 
sibilities is the familiar 2°"” involved 
in circuit analyses, with m = 2 for the 
number of values and m= 3 for the 
number of dimensions. 

Under the conditions described every 
single one of the eight instances would 
have to be presented before the in- 


dividual would be able to know what 
constituted the correct concept. And 
positive and negative instances would 
provide equivalent information, i.e., 
knowing that a particular instance was 
included and knowing that a particular 
instance was not included would be 
equally informative concerning the con- 
cept. This is the type of model in- 
volved in much of current information 
theory (4). 

If one were to tell S that all of the 
concepts would involve two out of the 
three dimensions (or one out of three) 
the number of hypotheses he would have 
to cohsider would be greatly reduced. 
He would then only have to consider the 
various combinations of dimensions 
times the number of possible arrange- 
ments among the instances involved 
within the two dimensions. In the case 
where two of the three dimensions were 
involved, there would then be three ways 
in which the dimensions could be chosen 
(,C,). The number of arrangements 
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within the dimensions would be 2” or 16. 
The 16 possibilities would be made up of 
the one extreme where all four instances 
were included and the opposite one 
where all were excluded, plus four where 
single instances were included, six where 
combinations of two, and four where 
combinations of three, were involved. 
Thus the total number of hypotheses 
to be considered would be 48, the prod- 
uct of the combinations of dimensions 
(3) and the arrangements within (16). 

Lastly, let us consider our situation 
where S knows how many dimensions 
there are to consider, how many will be 
necessary for the concept and in addi- 
tion knows how many values of each di- 
mension are required. Under these con- 
ditions the number of hypotheses will 
be determined by the number of ways 
the dimensions can be selected times the 
number of ways the values can be se- 
lected within the combination of dimen- 
sions. If S knows that two of the three 
dimensions will be relevant there will 
then be, as we have seen, three ways of 
picking combinations of two dimensions. 
Once these are chosen there will be only 
four ways (,C,)* of choosing the in- 
stances in such a way that one value of 
each relevant dimension is involved. 
Thus there will be a total of only 12 
hypotheses for S to consider (three for 
dimensions times four for values within 
the dimensions). 

The remainder of the present paper 
will be devoted entirely to an analysis of 
the third type of model, where the con- 
cept is one involving a systematic ar- 
rangement of the instances along par- 
ticular dimensions and with specified 
values of the relevant dimensions. S 
will be told what the characteristics of 
the concept are. Under these circum- 
stances positive and negative instances 
may not convey equal amounts of infor- 
mation about the concept. Our problem 
is the relative effectiveness of the two 
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kinds of instances under various circum- 
stances. 

If the third model is employed, how 
many instances would have to be pre- 
sented to reduce the number of hypothe- 
ses from the original 12 to the single one 
defined as correct by E? Let us say that 
the concept chosen in our example is 
that of a white circle (of any size). 
There will then be two positive instances 
(large white circle and small white cir- 
cle) and the remaining six will be nega- 
tive. 

In this example, if we use only posi- 
tive instances in the concept learning 
series, both of the possible positive in- 
stances are required to transmit the cor- 
rect concept. If the series is made up 
only of negative instances, one can reach 
the correct concept by successive elimi- 
nation of each of the six wrong instances. 
Actually, however, only five of the pos- 
sible six have to be transmitted since, as 
will be discussed below, one can deduce 
the correct concept with less than the 
total number of negative instances. 

Armed with the knowledge of how 
many instances of each type are re- 
quired, one can then pose one of the 
experimental questions studied by Hov- 
land and Weiss (2) as to how accurately 
S.will reach the correct concept when he 
is shown only the two positive instances 
as compared with the situation where he 
is shown only the five negative instances. 
The information provided is complete in 
either case, in the sense that a machine 
could be constructed which would reach 
the correct solution on the basis of the 
data presented. But the psychological 
processes of assimilating the two sets of 
information may be quite different, and 
one may be much more difficult than the 
other.” 

2The two positive and five negative in- 
stances are of course only equivalent with re- 
spect to amount of information relevant to 


the definition of the concept. But the five 
negative instances convey a greater total 
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Analysis can be made of what pos- 
sibilities are theoretically compatible 
with the conditions after varying num- 
bers of each type of instance. After two 
negative instances, for example, how 
many possibilities remain? What must 
be analyzed is the number of “possible 
hypotheses” after each instance. With 
the example used above, there are 12 
possible hypotheses as to the correct 
concept at the outset: black circle (of 
any size), black square, white circle, 
white square, large circle (of any color), 
small circle, large square, small square, 
large black object (of any shape), small 
black, large white, smali white. After 
the first positive instance (e.g., a small 
black circle) S can narrow the alterna- 
tives to those in which the size and color 
given are correct and shape irrelevant; 
the size and shape are correct and color 
irrelevant; or the color and shape cor- 
rect and size is irrelevant. In other 


words, he can know that the correct con- 
cept is one of the following: a small 


circle (of any color), a black circle (of 
any size) or a small black object (of 
any shape). Thus after the first posi- 
tive instance he is left with three hy- 
potheses. The second positive instance 
will narrow this down to ome (the cor- 
rect combination). Since this instance 
will be the same in two respects and dif- 
ferent in the third he will see which two 
dimensions are essential and which can 
have either value and still be correct. 
Thus a second positive instance of a 
small black square will indicate that 
small and black are essential and that 
shape is irrelevant. 

In the case of negative instances the 
individual also, of course, starts with 12 
hypotheses. The first negative instance 
will eliminate three of these possible hy- 
potheses. For example, being told that 
it is not a large black square rules out 


amount of information than the two positives, 
even if the surplus information is irrelevant 
for the present task. 
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the possibility that the correct concept 
is a large square, a black square, or a 
large black object, since any combina- 
tion where two of the dimensions were 
correct and the third irrelevant would 
make the instance correct. Three more 
possibilities can be removed with the 
second instance. For example, a nega- 
tive instance of a small white circle rules 
out small circle, white circle and small 
white object. Thus he now has six of 
the original 12 hypotheses left. But the 
third negative instance necessarily in- 
volves some duplication of information 
since it confirms the exclusion of one of 
the previously eliminated hypotheses 
and eliminates only two additional hy- 
potheses. (One: describes this situation 
as “redundancy” in information theory.) 
Similarly, two more hypotheses are elim- 
inated by the next instance, leaving two. 
The last instance will narrow the choice 
to the correct one, if all of the informa- 
tion previously presented is remembered 
correctly. Thus five instances will here 
eliminate 11 hypotheses, leaving only 
the correct one. 

Sometimes the term “concept” is used 
for the case where the classification is 
based on a single characteristic or rela- 
tionship (e.g., that of “circle” in Fig. 1). 
Under these conditions half of the eight 
instances would be positive and half 
negative. One would have to consider 
six possible hypotheses (each involving 
sets of four blocks in a single plane). 
It would take two positive instances [to 
specify the plane involved| or two nega- 
tive instances [to rule out all but one 
possible plane]. In this type of situa- 
tion the two types of instances are com- 
pletely complementary and equally ef- 
ficient carriers of information. This 
condition is similar to that typically con- 
sidered in “information theory.” Ex- 
perimental data of Buss (1) suggests 
that under these conditions learning may 
be as efficient with negative as with posi- 
tive cases. 
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In the two alternative situations one 
is usually as interested in the excluded 
cases as the included. Thus knowing 
the bases for classifying some members 
of a species as male permits one to 
classify all others as female. But in the 
type of concept with which this paper is 
primarily concerned only the particular 
combination specified may be of interest 
and combinations having the excluded 
characteristics of little concern. For ex- 
ample one may be concerned with the 
concept “ruby” characterized as a red, 
translucent stone, and have no interest 
in the category of non-red, non-trans- 
lucent stones. 

Let us now consider the original Oseas 
and Underwood (3) example. They 


used three shapes, three sizes, and three 
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shades. The concept was some combina- 
tion of two of the three dimensions. 
Their concepts would then be described 
as having three dimensions (two relevant 
and one irrelevant) with three possible 
values of each. Only one of the three 
levels was correct for each of the two 
relevant dimensions. With this arrange- 
ment there are 27 possible instances 
(3 x 3 X 3) and of these three will be 
positive (e.g., small black circle, small 
black square, and small black triangle). 
There will be 24 possible negative in- 
stances. A schema for these conditions 
is presented in Fig. 2. 

In terms of hypotheses, there are by 
coincidence also 27 possible ones at the 
outset, such as large black (object), 
white triangle, etc. [In terms of the 























(B) SHADE gray 

















A 











square 
SHAPE 
(C) 


triangle 


Fic. 2. Diagram showing total possible instances for three dimensions (size, shade, and shape) 
with three values of each. 





“COMMUNICATION ANALYSIS” OF CONCEPT LEARNING 


diagram, these represent the sets of 
three blocks in a line along one of the 
three primary axes. There are nine such 
lines along each axis.| Three are con- 
sonant with the first positive instance 
but there is only one consonant with 
both the first and second positive in- 
stance, so only two of the three possible 
positive instances need be transmitted. 
With negative instances the first in- 
stance eliminates three hypothesés, the 
second, three, the third, three, etc. After 
seven instances there is redundancy, so 
that after 21 hypotheses have been elim- 
inated the remaining 6 require a total 
of 3 negative instances to eliminate all 
but the correct hypothesis. Hence there 
are required a minimum of 10 negative 
instances. Thus two positive or ten 
negative instances will completely define 
the correct concept. [In terms of our 
geometrical figure two blocks will define 
the dimension along which adjacent 
blocks are lined up, but it will take 10 
placements in a three-dimensional ‘Tit- 
tat-toe” to plug all but one line of 
blocks. | 

In the foregoing example more nega- 
tive instances than positive were required. 
But this is not always the case. Con- 
sider the situation where there are three 
possible dimensions and five values along 
each, and where the correct concept in- 
volves four values of one of the dimen- 
sions. Let us say that color, size, and 
shape are again involved, and that each 
can have any one of five values. Thus 
color can be red, green, yellow, blue or 
black, size can be very large, large, me- 
dium, small, or very small and shape 
can be a circle, square, triangle, star, or 
diamond. If one chooses as the correct 
concept “a colored object” [an object of 
red, green, yellow, or blue (but not 
black)| (vf any shape or size) how 
many positive and negative instances 
will be required to transmit the correct 
concept to S? Analysis of this instance 
reveals that there are 125 possible in- 
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stances, of which 100 are correct in- 
stances (positives) and 25 incorrect 
(negatives). S would initially have to 
consider 15 possible hypotheses as to 
the combinations of dimensions and 
values. Five positive instances would 
serve to specify completely the correct 
concept. But it would take only two 
negative instances to do the same task. 
It will also be noted that in either case 
only a small fraction of the total in- 
stances would have to be used to define 
the concept completely. 

Now to generalize the results. It is 
possible to calculate from formula the 
number of hypotheses which can be 
formed and the number of positive and 
negative instances required to eliminate 
all alternative possibilities except the 
correct one. The model used is for con- 
cepts which employ from 2 to N dimen- 
sions with 2 to N values for each dimen- 
sion. The number of relevant dimen- 
sions can vary from one to one less than 
the total number and the number of cor- 
rect values for each relevant dimension 
can vary from one to one less than the 
total possible values. Let 


[oS . aoa 
sions, 

D = total number of dimen- 
sions to be considered, 

d = total number of rele- 
vant dimensions, 

V; =number of possible 
values for dimension # 
=A. 8,6, .< 3, 

% =number of _ correct 
values for dimension i. 


separate dimen- 


The total number of possible instances 
(7) is the number of values for the first 
dimension times the number for the sec- 
ond, third, etc. 


i=f¥, Ve Vo Soe hy Vp. (1) 


When the number of values is the same 
for each dimension this formula becomes 


1= V2. (1a) 
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The number of positive instances (Jp) 
is the product of the numbers of values 
which are correct for each dimension: 


Ij =UVaUptc* * * Up. (2) 


The number of values correct is less than 
the total number of values for each rele- 
vant dimension but is the entire number 
of values for the irrelevant dimensions. 
So when the number of values correct is 
the same for each relevant dimension, 
the formula reduces to the product of 
the number of values for the relevant di- 
mensions times the total number for the 
remaining dimensions: 


I, = vt VD-, (2a) 


The total number of negative in- 
stances (/,) can easily be obtained by 
subtraction: 


(3) 


While formulae can be presented for 
the general case with any number of 
values for each dimension, the remain- 
ing formulae will be for the frequent 
special case where the number of values 
is the same for each dimension. Under 
these circumstances the number of pos- 
sibilities, or hypotheses, which must be 
considered at the outset (when the num- 
ber of positive or negative instances = 
0) can be determined. When one speci- 
fies the number of possible dimensions 
and the number which are relevant, there 
are pC, possible ways in which these can 
be selected. Within each relevant di- 
mension the correct values can be se- 
lected in yC, ways, and there are d such 
dimensions. The total number of hy- 
potheses at the outset (H,) is accord- 
ingly 


H, = (pCa) (vC, )¢. (4) 


The number of hypotheses which must 
be considered after j number of positive 
instances (H,.,;) is 


H,.; = (pCa) (v-;Cy-;)4. (5) 
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Only one hypothesis (the correct one) 
remains after v + 1 instances have been 
presented: 


Ay-v41 = 1. (6) 


Thus the minimum number of positive 
instances required (M,) is one more 
than the number of correct values for 
the relevant dimensions. 


M,=v+1. (7) 


Another way of viewing this number is 
that it is the minimum necessary to dis- 
play all the non-relevant dimensions at a 
sufficient number of values to rule out 
the possibility that they are relevant. 
With the same number of instances one 
is able simultaneously to specify all the 
correct values for the relevant dimen- 
sions. So if there are three values cor- 
rect for dimensions A and B, and C is 
the irrelevant dimension, one must give 
instances with each of the three values 
of A and B plus a fourth instance involv- 
ing the fourth value of C. The latter in- 
formation indicates that C is an irrele- 
vant dimension. 

Since the initial number of hypotheses 
is of course identical whether one is to 
employ positive or negative instances 
(Hp-o = Hy=o) the number of possible 
hypotheses remaining after one negative 
instance is equal to the initial number 
minus the number specificed above as 
remaining after one positive instance: 


Bhsg © Hligue ~ Howe. (8) 


From this point on the number of pos- 
sible hypotheses does not always follow 
a simple pattern, because there is an in- 
determinate amount of overlap (‘re- 
dundancy”) between the hypotheses 
eliminated by each new instance and 
those which have been eliminated previ- 
ously.* Thus the minimum number of 


8 Except for the limiting case where only one 
relevant dimension is involved (d=1). Here 
Hany = (v-sCeo) (oCa) and Mp = V—v +1. 
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negative instances (M,) can be given 
only approximately at present. For the 
range of cases studied to date the num- 
ber is approximately * 


M,=(V—(v-1)]% (9) 


A check on the formulae presented 
can be made by determining empirically 
the minimum number of positive or of 
negative instances and the number of 
possible hypotheses which remain after 


4 When the number of dimensions is more 
than one greater than the number of values for 
each relevant dimension a correction term must 
be introduced. Robert Abelson suggests that 
for concepts with one value correct for each 
of two relevant dimensions when D >V +1 
the equation must be multiplied by a fraction 

log D 


approximately equal to log V 41)" 
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each successive instance has been pre- 
sented. Empirical values are presented 
in Table 1 for a variety of illustrative 
cases where D’s and V’s are between two 
and five. Perfect agreement with for- 
mula is obtained for all entries except 
for the minimum number of negative in- 
stances (M,,), which was stated to be 
only an approximation. For the cases 
illustrated the maximum deviation be- 
tween the empirical and predicted values 
is four instances. 

Consideration of the table and ior- 
mulae suggests conditions under which 
negative instances convey little or much 
information. In general, when the num- 
ber of values correct remains constant, 
as the total number of possible values 
increases the minimum number of nega- 


TABLE 1 


ILLUSTRATIVE CASES FOR CONCEPT MODEL WHERE NUMBERS OF 
DIMENSIONS AND VALUES ARE SPECIFIED 
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tive instances required to convey the 
concept increases. Thus in the case 
where the total number of dimensions is 
three, and there are two relevant dimen- 
sions with a single value of each, as one 
increases the number of values the min- 
imum number of positive instances stays 
constant at 2 but the minimum number 
of negative instances increases from 5 
when only two values are involved to 26 
when five are used. It can also be seen 
that as the number of relevant dimen- 
sions is increased the minimum number 
of negative instances increases, since the 
number of relevant dimensions is used 
as an exponent in the formula. For ex- 
ample, with four as the total number of 
dimensions and five as the number of 
values as one goes from one relevant di- 
mension to two and then to three the 
minimum number of positive instances 
stays constant at 2 but the number of 
negatives goes from 5 to 30 and then to 
127. 

The conditions where the most favor- 


able ratios of negative instance to posi- 
tive exist are those in which nearly all 
of the values of each relevant dimension 


are correct. One such instance was al- 
ready cited where fewer negative than 
positive instances were required (above, 
p. 467). Under these conditions one is 
really eliminating the values which are 
not involved and the negative instances 
do this operation more effectively than 
positive instances. 

Combinations of Positive and Nega- 
tive Instances. While the analysis of all 
positive or all negative series provides 
the greatest amount of knowledge about 
the information-transmitting characteris- 
tics of the two types of instance, there are 
many situations where both are used in 
the same concept-formation series. A 
sample case might be one where four di- 
mensions and two values are employed, 
with two relevant dimensions and one 
value of each correct. Here two positives 
or five negatives are needed if all in- 
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stances in either series are of the same 
type. However, two negatives can be 
substituted for one of the positives, so 
that a series containing one positive and 
two negative instances will provide the 
entire amount of information. Thus with 
size (large or small), shape (circle or 
square), color (red or black), and quan- 
tity (one or two of each figure) as di- 
mensions, the concept large circle (of 
either quantity and color) can be com- 
municated by showing a single large red 
circle as a positive instance, and a single 
large red square as one negative in- 
stance and a single small red circle as 
the other. 

From the standpoint of the informa- 
tion transmitted the sequence of positive 
and negative instances is immaterial, but 
psychologically there may be some in- 
teresting problems as to the order in 
which the instances are transmitted. 
When, for example, two positive and two 
negative instances will define a concept, 
it will be instructive to see if the con- 
cept is learned equally rapidly when the 
positives are first (since they reduce 
rapidly the number of hypotheses which 
are possible) and then the negatives 
(which pin-point the possibilities) as 
compared with the reverse order, where 
a large number of hypotheses are left 
after the first two negative instances. 
An experimental test of this hypothesis 
will be found in Hovland and Weiss (2). 

Other Models. The models which we 
have been discussing in this paper are 
of course only a small number out of the 
possible ones. A variety of challenging 
problems are suggested with other 
models. One simple variant is one in 
which the values of each dimension are 
interrelated in some systematic fashion. 
One pattern involves contiguous values 
with the restriction that only adjacent 
values are to be selected when more than 
one value is correct for each dimension. 
E.g., if two values of the size factor are 
involved they must be adjacent, like 
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small and medium, or medium and large, 
but not small and large. The effect of 
this requirement is to reduce the number 
of hypotheses and to require fewer in- 
stances. 

Another type of model is involved in 
contingent relationships, typified by a 
situation where values 1 and 2 of dimen- 
sions A and B are correct when dimen- 
sion C has value 1 but values 3 and 4 
are correct when C has value 2. There 
are certainly some real-life concepts of 
this type. With some modification they 
may be synthesized from the model used 
in the present paper, but may be more 
efficiently handled as a separate pattern. 

Variations in Procedure. Variations 
in the amount of prior knowledge of S 
about the number of dimensions and 
values to be used deserve careful ex- 
ploration. Preliminary work suggests 
that when there is no specification con- 
cerning the dimensions to be used, nega- 
tive instances are of great significance 
in eliminating false hypotheses concern- 
ing relevant dimensions and preventing 
overgeneralizing from all positive in- 
stances. 

Another interesting variation in pro- 
cedure involves changing the character 
of the information conveyed. In the ex- 
amples given in the present paper and in 
Smoke’s studies Ss only know that a 
negative instance is incorrect in some 
respect, but the locus of the variation is 
not specified. Analyses could be made 
of the concept-learning problem where 
Ss are told that the negative instance is 
wrong in one particular respect, or in 
two, etc. This may be the type of de- 
sign which is sometimes involved in the 
use of negative instances in classroom 
teaching where the exact nature of the 
deviation from the correct concept is 
specified. The opposite direction of 
variation is one in which the values and 
dimensions are not invariably associated 
in the concept, and Ss are only informed 
that the instance is “probably correct” 
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or “probably incorrect.” This type of 
procedure simulates many concept-learn- 
ing situations in everyday life where the 
characterization of correctness can only 
be made in probability terms. Studies 
of this type may help bridge the gap be- 
tween laboratory investigations and the 
complex conditions which obtain natu- 
ralistically. 

Finally, in the present paper the anal- 
ysis has been restricted to the minimum 
number of appropriately selected in- 
stances which are necessary to convey a 
particular concept. Another type of 
analysis would involve determining the 
average number of randomly selected in- 
stances required. Under these condi- 
tions high redundancy would be in- 
volved. It is likely that the type of 
set-up used by Smoke combines the un- 
certainties of this variation with the un- 
certainty produced by S’s not knowing 
the nature of the concept model. Smoke 
appears to have presented random-like 
variation of instances and the nature of 
the concept was not specified. Under 
these circumstances it would be no 
wonder that negative instances were 
found to be of so little value. 


SUMMARY 


Experimental studies by Smoke (5, 
6) and others on the effectiveness of 
positive and negative instances in con- 
cept formation leave unanswered the ex- 
tent to which the inefficiency of negative 
instances is due to S’s difficulty in as- 
similating information presented in this 
form (in terms of what the concept “is 
not”) and the extent to which it is due 
to the low efficiency of negative instances 
in transmitting the necessary informa- 
tion as to the characteristics of the con- 
cept. Further experimental work will 
have to hold the amount of information 
conveyed by the two types of instances 
constant in order to determine the rela- 
tive difficulty of learning from the two 
types of instance. 
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As preliminary to such investigations 
the present paper makes a theoretical 
analysis of one important concept model. 
On the basis of this analysis it is pos- 
sible to determine precisely the minimum 
number of each type of instance required 
to communicate correctly the character- 
istics of a concept to a S who knows the 
nature of the concept model and the 
number and types of dimensions which 
are to be considered. It is shown that 
for the model employed the relative 
number of instances of the two types 
required varies enormously as a func- 
tion of the total number of dimensions 
involved, the number of these which 
are relevant to the concept, the total 
number of values used for each dimen- 
sion, and the number of correct values 
for the relevant dimensions. Examples 


are given of conditions where only two 
positive instances but 625 negative in- 
stances are required to define the con- 
cept, and others where five positive in- 


stances but only two negatives are re- 
quired. Formulae derived theoretically 
are presented, together with a table giv- 
ing empirical data on the minimum num- 
ber of positive and negative instances 
required under various conditions. 

In the light of the considerations pre- 
sented, it is clear that the question asked 
in earlier concept-formation studies as to 
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the relative effectiveness of positive and 
negative instances cannot be given a gen- 
eralized categorical answer. Separate 
analyses must be made of (1) the 
amount of information conveyed by each 
type of instance under specified condi- 
tions and (2) the process of assimilat- 
ing information from the two types of 
instance when the amount of informa- 
tion transmitted is equated. 
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